Jul 23 18:59:05.607702 ip-10-0-128-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 18:59:05.607713 ip-10-0-128-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 18:59:05.607723 ip-10-0-128-42 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 18:59:05.608064 ip-10-0-128-42 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 18:59:15.632197 ip-10-0-128-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 23 18:59:15.632221 ip-10-0-128-42 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 52f57305f34e49cbae39a7f74d3cb033 -- Jul 23 19:01:12.442513 ip-10-0-128-42 systemd[1]: Starting Kubernetes Kubelet... Jul 23 19:01:12.848092 ip-10-0-128-42 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 19:01:12.848092 ip-10-0-128-42 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 19:01:12.848092 ip-10-0-128-42 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 19:01:12.848092 ip-10-0-128-42 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 19:01:12.848092 ip-10-0-128-42 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 19:01:12.849925 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.849806 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 19:01:12.855647 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855627 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 19:01:12.855647 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855643 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 19:01:12.855647 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855648 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 19:01:12.855647 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855652 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855656 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855661 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855665 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855668 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855672 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855678 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855684 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855688 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855692 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855697 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855701 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855704 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855709 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855713 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855717 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855722 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855726 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855729 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855733 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 19:01:12.855884 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855737 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855741 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855745 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855749 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855754 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855759 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855764 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855768 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855773 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855778 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855783 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855787 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855791 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855797 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855802 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855808 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855812 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855818 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855823 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855828 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 19:01:12.856758 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855832 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855836 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855841 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855845 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855849 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855853 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855857 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855861 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855866 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855870 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855874 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855878 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855882 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855886 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855890 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855894 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855900 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855906 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855910 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 19:01:12.857609 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855915 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855919 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855923 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855927 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855931 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855935 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855940 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855944 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855949 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855953 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855959 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855963 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855967 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855971 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855975 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855979 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855984 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855988 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855993 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 19:01:12.858379 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.855998 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856003 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856006 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856012 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856016 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856020 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856024 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856028 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856032 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856036 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856041 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856045 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856049 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856053 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856057 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856061 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856065 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.856070 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857270 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857280 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 19:01:12.859170 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857285 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857290 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857294 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857299 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857303 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857308 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857312 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857317 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857321 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857325 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857330 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857335 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857340 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857344 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857348 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857353 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857357 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857361 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857365 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857369 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 19:01:12.860028 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857374 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857379 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857383 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857387 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857392 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857396 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857400 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857404 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857408 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857412 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857416 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857420 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857424 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857429 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857433 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857440 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857452 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857457 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857469 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 19:01:12.860806 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857473 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857478 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857482 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857486 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857490 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857494 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857499 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857503 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857507 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857511 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857515 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857519 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857523 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857528 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857532 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857536 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857540 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857545 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857549 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 19:01:12.861434 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857553 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857560 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857564 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857568 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857572 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857576 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857580 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857584 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857589 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857593 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857596 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857608 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857615 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857620 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857625 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857629 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857633 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857637 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857641 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 19:01:12.862062 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857645 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857650 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857655 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857659 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857663 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857670 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857674 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857678 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857682 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857687 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857692 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857697 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857701 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857705 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857709 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857713 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857717 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857721 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857725 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.857730 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 19:01:12.862546 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858392 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858401 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858405 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858410 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858415 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858422 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858427 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858432 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858436 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858441 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858445 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858452 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858458 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858462 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858467 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858472 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858476 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858481 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858485 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858490 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 19:01:12.863097 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858494 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858499 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858503 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858507 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858511 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858515 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858519 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858523 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858527 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858531 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858536 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858540 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858544 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858548 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858552 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858556 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858560 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858568 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858572 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858577 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 19:01:12.863738 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858581 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858587 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858591 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858595 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858599 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858603 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858607 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858611 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858615 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858620 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858626 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858632 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858636 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858641 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858646 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858650 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858655 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858659 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858663 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 19:01:12.864269 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858667 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858671 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858676 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858680 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858684 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858687 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858692 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858696 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858700 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858704 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858711 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858719 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858723 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858728 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858732 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858736 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858740 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858744 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858749 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858753 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 19:01:12.864746 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858758 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858764 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858770 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858775 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858779 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858783 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858787 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858792 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858796 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858800 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858804 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858809 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858812 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858817 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858821 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858826 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858830 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858834 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858839 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.858843 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 19:01:12.865241 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858941 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858951 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858962 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858969 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858978 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858983 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858990 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.858997 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859001 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859006 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859011 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859017 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859022 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859026 2569 flags.go:64] FLAG: --cgroup-root="" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859033 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859037 2569 flags.go:64] FLAG: --client-ca-file="" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859042 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859047 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859055 2569 flags.go:64] FLAG: --cluster-domain="" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859060 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859065 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859070 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859076 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859081 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 19:01:12.865714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859086 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859091 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859097 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859102 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859107 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859111 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859116 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859121 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859127 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859132 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859139 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859144 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859148 2569 flags.go:64] FLAG: --enable-server="true" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859154 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859160 2569 flags.go:64] FLAG: --event-burst="100" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859165 2569 flags.go:64] FLAG: --event-qps="50" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859170 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859175 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859180 2569 flags.go:64] FLAG: --eviction-hard="" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859185 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859190 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859194 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859201 2569 flags.go:64] FLAG: --eviction-soft="" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859207 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859211 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 19:01:12.866367 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859216 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859237 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859242 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859247 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859252 2569 flags.go:64] FLAG: --feature-gates="" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859258 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859263 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859267 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859273 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859278 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859283 2569 flags.go:64] FLAG: --help="false" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859287 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-128-42.ec2.internal" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859292 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859297 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859302 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859308 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859313 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859319 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859324 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859328 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859333 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859338 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859344 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859348 2569 flags.go:64] FLAG: --kube-reserved="" Jul 23 19:01:12.867003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859353 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859357 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859362 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859367 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859371 2569 flags.go:64] FLAG: --lock-file="" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859378 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859383 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859388 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859398 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859402 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859407 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859411 2569 flags.go:64] FLAG: --logging-format="text" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859416 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859421 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859426 2569 flags.go:64] FLAG: --manifest-url="" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859431 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859438 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859442 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859448 2569 flags.go:64] FLAG: --max-pods="110" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859453 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859458 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859462 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859467 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859472 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859477 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 19:01:12.867611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859482 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859495 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859500 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859504 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859509 2569 flags.go:64] FLAG: --pod-cidr="" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859514 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859523 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859528 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859533 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859537 2569 flags.go:64] FLAG: --port="10250" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859543 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859547 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-022af3ffbc3c90a9c" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859552 2569 flags.go:64] FLAG: --qos-reserved="" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859559 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859564 2569 flags.go:64] FLAG: --register-node="true" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859570 2569 flags.go:64] FLAG: --register-with-taints="" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859575 2569 flags.go:64] FLAG: --registry-burst="10" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859580 2569 flags.go:64] FLAG: --registry-qps="5" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859584 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859589 2569 flags.go:64] FLAG: --reserved-memory="" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859595 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859600 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859605 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859609 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859614 2569 flags.go:64] FLAG: --runonce="false" Jul 23 19:01:12.868240 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859619 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859624 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859629 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859633 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859638 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859642 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859647 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859653 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859657 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859662 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859666 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859671 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859676 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859681 2569 flags.go:64] FLAG: --system-cgroups="" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859686 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859694 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859699 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859703 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859711 2569 flags.go:64] FLAG: --tls-min-version="" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859715 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859722 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859727 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859731 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859736 2569 flags.go:64] FLAG: --v="2" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859742 2569 flags.go:64] FLAG: --version="false" Jul 23 19:01:12.868862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859748 2569 flags.go:64] FLAG: --vmodule="" Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859754 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.859760 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859948 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859954 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859960 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859965 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859970 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859975 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859980 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859984 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859988 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.859995 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860002 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860007 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860011 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860017 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860021 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860025 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860029 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 19:01:12.869477 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860033 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860038 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860042 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860046 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860052 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860059 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860065 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860071 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860075 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860080 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860084 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860088 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860092 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860096 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860100 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860105 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860109 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860113 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860117 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 19:01:12.870113 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860122 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860126 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860130 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860134 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860138 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860145 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860150 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860155 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860159 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860164 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860168 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860172 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860176 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860180 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860185 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860190 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860194 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860200 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860204 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 19:01:12.871213 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860208 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860212 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860216 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860236 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860242 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860246 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860250 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860254 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860258 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860262 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860266 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860270 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860274 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860278 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860282 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860286 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860290 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860294 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860298 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860302 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 19:01:12.871724 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860307 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860311 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860315 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860320 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860324 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860328 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860332 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860337 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860341 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860346 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860352 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860356 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860360 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860364 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860368 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860373 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860377 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860381 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860385 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860389 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 19:01:12.872196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860393 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860398 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860402 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.860407 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.860419 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.867617 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.867631 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.867654 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.867660 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867727 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867732 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867736 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867739 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867743 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 19:01:12.872735 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867746 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867748 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867752 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867756 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867760 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867763 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867767 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867770 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867773 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867775 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867779 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867782 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867785 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867787 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867790 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867793 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867796 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867798 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867801 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 19:01:12.873102 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867804 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867807 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867809 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867812 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867815 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867819 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867822 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867824 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867827 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867829 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867832 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867834 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867837 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867839 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867841 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867844 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867846 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867849 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867851 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867854 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 19:01:12.873573 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867856 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867858 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867861 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867864 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867866 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867868 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867871 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867873 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867876 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867879 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867881 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867883 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867886 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867889 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867891 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867895 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867900 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867903 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867906 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 19:01:12.874096 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867909 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867911 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867914 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867916 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867919 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867921 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867924 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867927 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867929 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867932 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867934 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867937 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867939 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867941 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867944 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867946 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867949 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867951 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867954 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867956 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 19:01:12.874578 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867958 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867961 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867963 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867966 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867968 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867971 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867974 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867976 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867979 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867982 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867985 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867987 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867991 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867993 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867996 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 19:01:12.875127 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.867998 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.868003 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868120 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868126 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868129 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868132 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868135 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868137 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868140 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868142 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868145 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868147 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868150 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868152 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868155 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 19:01:12.875556 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868157 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868160 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868162 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868166 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868170 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868173 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868176 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868179 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868181 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868183 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868186 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868189 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868191 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868194 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868196 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868199 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868202 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868205 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868207 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868210 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 19:01:12.875919 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868212 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868215 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868217 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868219 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868235 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868238 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868240 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868243 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868246 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868249 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868252 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868254 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868257 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868260 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868263 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868265 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868269 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868273 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868276 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 19:01:12.876704 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868279 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868282 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868284 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868288 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868291 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868293 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868296 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868298 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868301 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868304 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868307 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868309 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868311 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868314 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868317 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868319 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868321 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868324 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868326 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868329 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 19:01:12.877419 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868331 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868333 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868336 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868339 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868341 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868344 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868346 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868349 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868351 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868354 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868356 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868359 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868361 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868363 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868366 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868369 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868371 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868374 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868377 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 19:01:12.877975 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868381 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868383 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868385 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868389 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868391 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868393 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868396 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:12.868398 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.868403 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.868515 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.872295 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.873625 2569 server.go:1019] "Starting client certificate rotation" Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.873731 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 19:01:12.878696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.874625 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 19:01:12.879075 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.876089 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 19:01:12.879075 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.878893 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 19:01:12.888569 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.888553 2569 log.go:25] "Validated CRI v1 runtime API" Jul 23 19:01:12.890693 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.890675 2569 log.go:25] "Validated CRI v1 image API" Jul 23 19:01:12.892087 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.892069 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 19:01:12.895824 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.895798 2569 fs.go:135] Filesystem UUIDs: map[4f00b1a6-3e76-48aa-8aaa-28ad6265b22e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e7dee8d1-ddf8-4881-a27a-f8a764b83d06:/dev/nvme0n1p4] Jul 23 19:01:12.895894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.895823 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 19:01:12.901140 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.901032 2569 manager.go:216] Machine: {Timestamp:2026-07-23 19:01:12.899523209 +0000 UTC m=+0.323521391 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093307 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a00f470de8e0a2522c8e846064102 SystemUUID:ec2a00f4-70de-8e0a-2522-c8e846064102 BootID:52f57305-f34e-49cb-ae39-a7f74d3cb033 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:c9:15:16:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:c9:15:16:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:22:0b:1d:4c:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 19:01:12.901140 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.901140 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 19:01:12.901289 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.901276 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 19:01:12.903963 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.903939 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 19:01:12.904116 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.903967 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 19:01:12.904694 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.904684 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 19:01:12.904733 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.904697 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 19:01:12.904733 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.904704 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 19:01:12.905264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.905253 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 19:01:12.906416 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.906406 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 19:01:12.908330 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.908313 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 19:01:12.909305 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909293 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 23 19:01:12.909435 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909425 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 19:01:12.909475 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909466 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 23 19:01:12.909507 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909489 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 19:01:12.909507 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909504 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 19:01:12.909586 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909517 2569 kubelet.go:398] "Adding apiserver pod source" Jul 23 19:01:12.909586 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.909529 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 19:01:12.911346 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.911288 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 19:01:12.911441 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.911372 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 19:01:12.913835 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.913814 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 19:01:12.915267 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915252 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 19:01:12.915355 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915283 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 19:01:12.915895 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915882 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 19:01:12.915943 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915899 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 19:01:12.915943 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915906 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 19:01:12.915943 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915912 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 19:01:12.915943 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915920 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 19:01:12.915943 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915926 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 19:01:12.916079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915983 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 19:01:12.916079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915989 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 19:01:12.916079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.915996 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 19:01:12.916079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.916001 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 19:01:12.916079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.916015 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 19:01:12.916079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.916022 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 19:01:12.916658 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.916648 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 19:01:12.916658 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.916657 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 19:01:12.919930 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.919912 2569 server.go:1268] "Started kubelet" Jul 23 19:01:12.920026 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.920000 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 19:01:12.920117 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.920054 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 19:01:12.920176 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.920144 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 19:01:12.920979 ip-10-0-128-42 systemd[1]: Started Kubernetes Kubelet. Jul 23 19:01:12.921304 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.921149 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 19:01:12.922370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.922356 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 23 19:01:12.923816 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.923786 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 19:01:12.923890 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.923843 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 19:01:12.925194 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.925168 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 19:01:12.928673 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.928657 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 19:01:12.928758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.928680 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 19:01:12.928854 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.928837 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:12.928975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.928941 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 19:01:12.929442 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929422 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929445 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929459 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.928635 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c50067bfb0125f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-23 19:01:12.919888479 +0000 UTC m=+0.343886662,LastTimestamp:2026-07-23 19:01:12.919888479 +0000 UTC m=+0.343886662,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}" Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929550 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929559 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929587 2569 factory.go:55] Registering systemd factory Jul 23 19:01:12.929604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929602 2569 factory.go:223] Registration of the systemd container factory successfully Jul 23 19:01:12.929924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929804 2569 factory.go:153] Registering CRI-O factory Jul 23 19:01:12.929924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929817 2569 factory.go:223] Registration of the crio container factory successfully Jul 23 19:01:12.929924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929868 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 19:01:12.929924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929885 2569 factory.go:103] Registering Raw factory Jul 23 19:01:12.929924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.929897 2569 manager.go:1196] Started watching for new ooms in manager Jul 23 19:01:12.930523 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.930510 2569 manager.go:349] Starting recovery of all containers Jul 23 19:01:12.935616 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.934984 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 19:01:12.935616 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.935109 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 19:01:12.940538 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.940436 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5pw7" Jul 23 19:01:12.941550 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.941533 2569 manager.go:354] Recovery completed Jul 23 19:01:12.945797 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.945711 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:12.948214 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948198 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:12.948298 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948250 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:12.948298 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948268 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:12.948840 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948826 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 19:01:12.948840 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948838 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 19:01:12.948840 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948839 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:12.948956 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.948852 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 23 19:01:12.949653 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.949635 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:12.949718 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.949662 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:12.949718 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.949673 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:12.950233 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.950207 2569 policy_none.go:49] "None policy: Start" Jul 23 19:01:12.950286 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.950247 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 19:01:12.950286 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.950260 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 19:01:12.950349 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:12.950280 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c50067c1605bce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-23 19:01:12.94821883 +0000 UTC m=+0.372217020,LastTimestamp:2026-07-23 19:01:12.94821883 +0000 UTC m=+0.372217020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}" Jul 23 19:01:12.950609 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.950594 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5pw7" Jul 23 19:01:12.951925 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:12.951915 2569 policy_none.go:47] "Start" Jul 23 19:01:13.002079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.001879 2569 manager.go:337] "Starting Device Plugin manager" Jul 23 19:01:13.002185 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.002121 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 19:01:13.002185 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.002134 2569 server.go:87] "Starting device plugin registration server" Jul 23 19:01:13.002389 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.002377 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 19:01:13.002425 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.002390 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 19:01:13.002532 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.002513 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 19:01:13.002622 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.002599 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 19:01:13.002622 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.002609 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 19:01:13.003165 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.003146 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 19:01:13.003263 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.003201 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.071179 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.071147 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 19:01:13.072454 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.072440 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 19:01:13.072534 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.072477 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 19:01:13.073002 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.072978 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 19:01:13.073090 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.073023 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 19:01:13.076052 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.076023 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 19:01:13.103548 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.103516 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:13.104446 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.104432 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:13.104518 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.104470 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:13.104518 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.104486 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:13.104518 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.104512 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.112374 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.112361 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.112430 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.112385 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-42.ec2.internal\": node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.134736 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.134678 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.173323 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.173291 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"] Jul 23 19:01:13.173414 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.173369 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:13.174408 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.174392 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:13.174478 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.174422 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:13.174478 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.174434 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:13.175783 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.175770 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:13.175905 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.175883 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.175959 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.175921 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:13.176605 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.176589 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:13.176706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.176623 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:13.176706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.176638 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:13.176706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.176589 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:13.176706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.176698 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:13.176890 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.176710 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:13.177814 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.177795 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.177902 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.177827 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 19:01:13.178627 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.178606 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory" Jul 23 19:01:13.178700 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.178642 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 19:01:13.178700 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.178660 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID" Jul 23 19:01:13.204052 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.204028 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-42.ec2.internal\" not found" node="ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.208621 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.208605 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-42.ec2.internal\" not found" node="ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.232894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.232871 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbf712eebfab4ddd93a32b2493fa8fed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"dbf712eebfab4ddd93a32b2493fa8fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.232972 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.232903 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbf712eebfab4ddd93a32b2493fa8fed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"dbf712eebfab4ddd93a32b2493fa8fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.232972 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.232919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6afd729819b14aa08ff5546801a18817-config\") pod \"kube-apiserver-proxy-ip-10-0-128-42.ec2.internal\" (UID: \"6afd729819b14aa08ff5546801a18817\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.235132 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.235115 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.333996 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.333968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbf712eebfab4ddd93a32b2493fa8fed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"dbf712eebfab4ddd93a32b2493fa8fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.333996 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.333985 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbf712eebfab4ddd93a32b2493fa8fed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"dbf712eebfab4ddd93a32b2493fa8fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.334144 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.334022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbf712eebfab4ddd93a32b2493fa8fed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"dbf712eebfab4ddd93a32b2493fa8fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.334144 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.334048 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6afd729819b14aa08ff5546801a18817-config\") pod \"kube-apiserver-proxy-ip-10-0-128-42.ec2.internal\" (UID: \"6afd729819b14aa08ff5546801a18817\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.334144 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.334060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbf712eebfab4ddd93a32b2493fa8fed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"dbf712eebfab4ddd93a32b2493fa8fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.334144 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.334106 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6afd729819b14aa08ff5546801a18817-config\") pod \"kube-apiserver-proxy-ip-10-0-128-42.ec2.internal\" (UID: \"6afd729819b14aa08ff5546801a18817\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.335473 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.335458 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.436076 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.435991 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.510929 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.510892 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.512077 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.512058 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" Jul 23 19:01:13.537020 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.536989 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.637738 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.637685 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.738198 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.738122 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.839307 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.839267 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.874173 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.874136 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 19:01:13.874649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.874356 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 19:01:13.939602 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:13.939550 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:13.954862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.954829 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:56:13 +0000 UTC" deadline="2028-03-17 13:28:34.453465633 +0000 UTC" Jul 23 19:01:13.954862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.954858 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14466h27m20.498610753s" Jul 23 19:01:13.955413 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:13.955396 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 19:01:14.039916 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:14.039837 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:14.140950 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:14.140916 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:14.166270 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:14.166232 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf712eebfab4ddd93a32b2493fa8fed.slice/crio-cd134c49406b16b2093bea1c7ccd09fe3e3ec2d6ca2c494bbac4eb748381926d WatchSource:0}: Error finding container cd134c49406b16b2093bea1c7ccd09fe3e3ec2d6ca2c494bbac4eb748381926d: Status 404 returned error can't find the container with id cd134c49406b16b2093bea1c7ccd09fe3e3ec2d6ca2c494bbac4eb748381926d Jul 23 19:01:14.170726 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.170704 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 19:01:14.236078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.236045 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 19:01:14.241450 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:14.241429 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found" Jul 23 19:01:14.276606 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.276584 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 19:01:14.297865 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:14.297839 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afd729819b14aa08ff5546801a18817.slice/crio-c9301a707da19668bd6bc49237f2b3f002a525c15250bf4a9c844bedf8b0e9e7 WatchSource:0}: Error finding container c9301a707da19668bd6bc49237f2b3f002a525c15250bf4a9c844bedf8b0e9e7: Status 404 returned error can't find the container with id c9301a707da19668bd6bc49237f2b3f002a525c15250bf4a9c844bedf8b0e9e7 Jul 23 19:01:14.329564 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.329531 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" Jul 23 19:01:14.355635 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.355611 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 19:01:14.356692 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.356677 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" Jul 23 19:01:14.369024 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.369006 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 19:01:14.912346 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.912307 2569 apiserver.go:52] "Watching apiserver" Jul 23 19:01:14.919544 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.919518 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 19:01:14.919977 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.919942 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-p6msx","openshift-image-registry/node-ca-6cjn4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal","openshift-multus/network-metrics-daemon-k7nsr","openshift-network-diagnostics/network-check-target-54n5t","openshift-ovn-kubernetes/ovnkube-node-w5vwg","kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk","openshift-cluster-node-tuning-operator/tuned-4m792","openshift-multus/multus-7kd28","openshift-multus/multus-additional-cni-plugins-lhqvp","openshift-network-operator/iptables-alerter-vmcvx","kube-system/global-pull-secret-syncer-8p7m6","kube-system/konnectivity-agent-twdst"] Jul 23 19:01:14.921484 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.921459 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.922745 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.922721 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:14.922849 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:14.922818 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:14.924014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.923940 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 19:01:14.924143 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.924044 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 19:01:14.924143 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.924064 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.924143 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.924084 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:14.924344 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.924204 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.924494 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.924473 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jhpsj\"" Jul 23 19:01:14.925141 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.925121 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:14.925229 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:14.925206 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:14.928839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.926742 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-265hr\"" Jul 23 19:01:14.928839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.927450 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 19:01:14.928839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.927480 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 19:01:14.929269 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.929223 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:14.929389 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:14.929324 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:14.929389 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.929375 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 19:01:14.931404 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.930783 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.932475 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.932380 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:14.933583 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.933563 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:14.935029 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.935008 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:14.935808 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.935788 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 19:01:14.936167 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936145 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.936256 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936170 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 19:01:14.936256 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936198 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.936470 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936452 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:14.936581 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936562 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 19:01:14.936655 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936623 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 19:01:14.936733 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936714 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rnrlk\"" Jul 23 19:01:14.936956 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936934 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p6cd8\"" Jul 23 19:01:14.937086 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.937069 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 19:01:14.937158 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.936998 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.937158 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.937076 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.937279 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.937262 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.937440 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.937417 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t7ljg\"" Jul 23 19:01:14.937826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.937808 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:14.938309 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.938279 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.938541 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.938524 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 19:01:14.938986 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.938611 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.938986 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.938825 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.938986 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.938921 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hqxvj\"" Jul 23 19:01:14.939546 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.939521 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:14.940817 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.940799 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nq9pp\"" Jul 23 19:01:14.940911 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.940895 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 19:01:14.941204 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.941182 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.941316 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.941255 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fj7gq\"" Jul 23 19:01:14.941387 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.941372 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 19:01:14.941499 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.941481 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.942011 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.941995 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 19:01:14.942343 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.942320 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 19:01:14.942456 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.942438 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jgngt\"" Jul 23 19:01:14.942531 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.942471 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 19:01:14.944501 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-run-netns\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944603 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-var-lib-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944603 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944534 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-node-log\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944603 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-cni-bin\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944603 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944595 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr84p\" (UniqueName: \"kubernetes.io/projected/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-kube-api-access-nr84p\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944791 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944657 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-multus-certs\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.944791 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-slash\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944791 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-etc-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944791 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-env-overrides\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.944791 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-k8s-cni-cncf-io\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944813 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-kubelet\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944872 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-cni-multus\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-kubelet\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944937 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-conf-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944960 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:14.945015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.944987 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-os-release\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovnkube-script-lib\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945069 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d852daa-548b-42b9-a2ec-5a5003ac0cff-kubelet-config\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945092 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e9e4424-1675-4d06-84dc-c92e423de55e-agent-certs\") pod \"konnectivity-agent-twdst\" (UID: \"7e9e4424-1675-4d06-84dc-c92e423de55e\") " pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945108 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945124 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-system-cni-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-cnibin\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945245 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-netns\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945304 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d852daa-548b-42b9-a2ec-5a5003ac0cff-dbus\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:14.945362 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-ovn\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.945730 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-cni-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945776 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945761 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6f859d3-7891-4261-8bcc-7a0d3098f186-cni-binary-copy\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945794 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-cni-bin\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-etc-kubernetes\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.945887 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945843 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcl8g\" (UniqueName: \"kubernetes.io/projected/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-kube-api-access-bcl8g\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:14.945887 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945865 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-systemd-units\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.945887 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945883 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-log-socket\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.946008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945906 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-socket-dir-parent\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.946008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945931 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-hostroot\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.946008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945973 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-daemon-config\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.946008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.945990 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7kg2\" (UniqueName: \"kubernetes.io/projected/d6f859d3-7891-4261-8bcc-7a0d3098f186-kube-api-access-t7kg2\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:14.946154 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946019 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-systemd\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.946154 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946041 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.946154 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946062 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-cni-netd\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.946154 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946077 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovnkube-config\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.946154 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946119 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovn-node-metrics-cert\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:14.946154 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:14.946394 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.946156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e9e4424-1675-4d06-84dc-c92e423de55e-konnectivity-ca\") pod \"konnectivity-agent-twdst\" (UID: \"7e9e4424-1675-4d06-84dc-c92e423de55e\") " pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:14.954471 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.954446 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 19:01:14.986862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.986835 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-drxvf" Jul 23 19:01:14.999095 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:14.998883 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-drxvf" Jul 23 19:01:15.030455 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.030426 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 19:01:15.046816 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.046785 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-systemd\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.046984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.046836 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-cni-netd\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.046984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.046907 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovn-node-metrics-cert\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.046984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.046954 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e9e4424-1675-4d06-84dc-c92e423de55e-konnectivity-ca\") pod \"konnectivity-agent-twdst\" (UID: \"7e9e4424-1675-4d06-84dc-c92e423de55e\") " pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.046983 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-modprobe-d\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047010 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysconfig\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.046981 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-cni-netd\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-system-cni-dir\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-run-netns\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047123 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-run-netns\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047116 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-node-log\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047170 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr84p\" (UniqueName: \"kubernetes.io/projected/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-kube-api-access-nr84p\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-multus-certs\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047270 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-node-log\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047300 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysctl-d\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047331 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047360 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6llhv\" (UniqueName: \"kubernetes.io/projected/4c011ca9-67c5-4965-9a90-8cc4058985f7-kube-api-access-6llhv\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047403 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-slash\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047417 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-k8s-cni-cncf-io\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047459 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-sys\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047485 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43675326-e285-4684-b1a6-3ceaed111497-etc-tuned\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-host\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.047558 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047535 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-kubelet\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-cni-multus\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047608 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-multus-certs\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047630 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e9e4424-1675-4d06-84dc-c92e423de55e-konnectivity-ca\") pod \"konnectivity-agent-twdst\" (UID: \"7e9e4424-1675-4d06-84dc-c92e423de55e\") " pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-kubelet\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-kubelet\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047715 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-conf-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047734 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-k8s-cni-cncf-io\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047744 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-kubelet\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.047828 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047868 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-lib-modules\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-serviceca\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-conf-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047923 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-os-release\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047920 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-cni-multus\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.047996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-os-release\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.048257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048004 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d852daa-548b-42b9-a2ec-5a5003ac0cff-kubelet-config\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048043 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e9e4424-1675-4d06-84dc-c92e423de55e-agent-certs\") pod \"konnectivity-agent-twdst\" (UID: \"7e9e4424-1675-4d06-84dc-c92e423de55e\") " pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.048082 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:15.548043915 +0000 UTC m=+2.972042123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048094 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048147 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d852daa-548b-42b9-a2ec-5a5003ac0cff-kubelet-config\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048250 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048277 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4h8q\" (UniqueName: \"kubernetes.io/projected/79265418-0732-4d6c-ade9-b49691f561d9-kube-api-access-h4h8q\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048306 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048336 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-cnibin\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048381 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-ovn\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-etc-kubernetes\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048422 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43675326-e285-4684-b1a6-3ceaed111497-tmp\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048476 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-ovn\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048481 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-socket-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048456 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-cnibin\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.049186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048484 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-etc-kubernetes\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048520 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-tmp-dir\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048546 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-cnibin\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-log-socket\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048597 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-slash\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-hostroot\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048638 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-log-socket\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048681 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-hostroot\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048702 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysctl-conf\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048732 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-device-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-hosts-file\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048794 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048818 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048850 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-kubernetes\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-systemd\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048933 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-systemd\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050072 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.048984 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovnkube-config\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049030 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-run-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049038 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-run\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049062 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79265418-0732-4d6c-ade9-b49691f561d9-host-slash\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-var-lib-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049112 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-cni-bin\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049162 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-etc-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049187 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-env-overrides\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-host\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049236 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-sys-fs\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zb84\" (UniqueName: \"kubernetes.io/projected/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-kube-api-access-5zb84\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049335 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79265418-0732-4d6c-ade9-b49691f561d9-iptables-alerter-script\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049366 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:15.050975 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049391 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovnkube-script-lib\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049449 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-registration-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049477 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-system-cni-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-netns\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049532 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d852daa-548b-42b9-a2ec-5a5003ac0cff-dbus\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-var-lib-kubelet\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049587 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-os-release\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965m2\" (UniqueName: \"kubernetes.io/projected/9b5a389d-3d26-4712-afd7-215689dd0aa1-kube-api-access-965m2\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049650 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-cni-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovnkube-config\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049676 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6f859d3-7891-4261-8bcc-7a0d3098f186-cni-binary-copy\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-cni-bin\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049752 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcl8g\" (UniqueName: \"kubernetes.io/projected/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-kube-api-access-bcl8g\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.049770 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049780 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf7nh\" (UniqueName: \"kubernetes.io/projected/43675326-e285-4684-b1a6-3ceaed111497-kube-api-access-nf7nh\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j68hl\" (UniqueName: \"kubernetes.io/projected/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-kube-api-access-j68hl\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.049818 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:01:15.549802645 +0000 UTC m=+2.973800821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:15.051843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049848 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-systemd-units\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049876 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-socket-dir-parent\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-daemon-config\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.049936 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7kg2\" (UniqueName: \"kubernetes.io/projected/d6f859d3-7891-4261-8bcc-7a0d3098f186-kube-api-access-t7kg2\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050241 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-var-lib-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050280 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6f859d3-7891-4261-8bcc-7a0d3098f186-cni-binary-copy\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050292 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-host-cni-bin\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050354 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-var-lib-cni-bin\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050397 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-etc-openvswitch\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050545 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-host-run-netns\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050760 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-env-overrides\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050867 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-system-cni-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050956 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-cni-dir\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050956 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d852daa-548b-42b9-a2ec-5a5003ac0cff-dbus\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.050996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-systemd-units\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.051048 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-socket-dir-parent\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.051220 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovnkube-script-lib\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.052758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.051614 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6f859d3-7891-4261-8bcc-7a0d3098f186-multus-daemon-config\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.053622 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.053112 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e9e4424-1675-4d06-84dc-c92e423de55e-agent-certs\") pod \"konnectivity-agent-twdst\" (UID: \"7e9e4424-1675-4d06-84dc-c92e423de55e\") " pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:15.056822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.056799 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-ovn-node-metrics-cert\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.060384 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.060364 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:15.060384 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.060386 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:15.060548 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.060400 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:15.060548 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.060449 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:15.560433852 +0000 UTC m=+2.984432024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:15.061705 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.061681 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr84p\" (UniqueName: \"kubernetes.io/projected/a6b6853a-9473-4fa0-b811-f7f71c3a0bbd-kube-api-access-nr84p\") pod \"ovnkube-node-w5vwg\" (UID: \"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.062165 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.062141 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7kg2\" (UniqueName: \"kubernetes.io/projected/d6f859d3-7891-4261-8bcc-7a0d3098f186-kube-api-access-t7kg2\") pod \"multus-7kd28\" (UID: \"d6f859d3-7891-4261-8bcc-7a0d3098f186\") " pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.063757 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.063733 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcl8g\" (UniqueName: \"kubernetes.io/projected/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-kube-api-access-bcl8g\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:15.079648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.079594 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" event={"ID":"6afd729819b14aa08ff5546801a18817","Type":"ContainerStarted","Data":"c9301a707da19668bd6bc49237f2b3f002a525c15250bf4a9c844bedf8b0e9e7"} Jul 23 19:01:15.081016 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.080953 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" event={"ID":"dbf712eebfab4ddd93a32b2493fa8fed","Type":"ContainerStarted","Data":"cd134c49406b16b2093bea1c7ccd09fe3e3ec2d6ca2c494bbac4eb748381926d"} Jul 23 19:01:15.151370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.150826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-registration-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.151370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.150868 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-var-lib-kubelet\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.151370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.150900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-os-release\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.151370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.150926 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-965m2\" (UniqueName: \"kubernetes.io/projected/9b5a389d-3d26-4712-afd7-215689dd0aa1-kube-api-access-965m2\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.151370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.150963 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf7nh\" (UniqueName: \"kubernetes.io/projected/43675326-e285-4684-b1a6-3ceaed111497-kube-api-access-nf7nh\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.151370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.151002 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j68hl\" (UniqueName: \"kubernetes.io/projected/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-kube-api-access-j68hl\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.151974 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-registration-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.151898 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-os-release\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.151639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-var-lib-kubelet\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152011 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-systemd\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152084 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-modprobe-d\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152155 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-systemd\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152301 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-modprobe-d\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152341 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysconfig\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-system-cni-dir\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysctl-d\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152472 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6llhv\" (UniqueName: \"kubernetes.io/projected/4c011ca9-67c5-4965-9a90-8cc4058985f7-kube-api-access-6llhv\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152538 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-sys\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152569 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43675326-e285-4684-b1a6-3ceaed111497-etc-tuned\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152595 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-host\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-lib-modules\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.153580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152678 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-serviceca\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152709 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152740 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4h8q\" (UniqueName: \"kubernetes.io/projected/79265418-0732-4d6c-ade9-b49691f561d9-kube-api-access-h4h8q\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43675326-e285-4684-b1a6-3ceaed111497-tmp\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152803 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-socket-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152836 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-tmp-dir\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152850 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-sys\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152861 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-cnibin\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152917 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysctl-conf\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152955 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-device-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152990 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-hosts-file\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153028 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153060 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153096 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-kubernetes\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-run\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153191 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79265418-0732-4d6c-ade9-b49691f561d9-host-slash\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.152918 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-cnibin\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.154584 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153229 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-host\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153322 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-sys-fs\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153324 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysconfig\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153362 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153393 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-kubernetes\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153471 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153506 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysctl-conf\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153522 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-system-cni-dir\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153534 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-etc-sysctl-d\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153598 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-hosts-file\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153394 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zb84\" (UniqueName: \"kubernetes.io/projected/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-kube-api-access-5zb84\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.153919 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79265418-0732-4d6c-ade9-b49691f561d9-iptables-alerter-script\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154076 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-device-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154155 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-host\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154195 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154214 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-run\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.155439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154261 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79265418-0732-4d6c-ade9-b49691f561d9-host-slash\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154348 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-sys-fs\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154504 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b5a389d-3d26-4712-afd7-215689dd0aa1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154611 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79265418-0732-4d6c-ade9-b49691f561d9-iptables-alerter-script\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154665 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-host\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154783 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.154820 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43675326-e285-4684-b1a6-3ceaed111497-lib-modules\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.155139 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c011ca9-67c5-4965-9a90-8cc4058985f7-socket-dir\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.155389 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-tmp-dir\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.155461 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-serviceca\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.156044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.155827 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43675326-e285-4684-b1a6-3ceaed111497-etc-tuned\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.156857 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.156832 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b5a389d-3d26-4712-afd7-215689dd0aa1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.161737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.161696 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43675326-e285-4684-b1a6-3ceaed111497-tmp\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.164251 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.164179 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j68hl\" (UniqueName: \"kubernetes.io/projected/b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095-kube-api-access-j68hl\") pod \"node-resolver-p6msx\" (UID: \"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095\") " pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.165743 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.165716 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6llhv\" (UniqueName: \"kubernetes.io/projected/4c011ca9-67c5-4965-9a90-8cc4058985f7-kube-api-access-6llhv\") pod \"aws-ebs-csi-driver-node-56rzk\" (UID: \"4c011ca9-67c5-4965-9a90-8cc4058985f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.165850 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.165786 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-965m2\" (UniqueName: \"kubernetes.io/projected/9b5a389d-3d26-4712-afd7-215689dd0aa1-kube-api-access-965m2\") pod \"multus-additional-cni-plugins-lhqvp\" (UID: \"9b5a389d-3d26-4712-afd7-215689dd0aa1\") " pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.165850 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.165823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zb84\" (UniqueName: \"kubernetes.io/projected/a435ed1a-6236-422a-a2a8-ed4a5997cbe2-kube-api-access-5zb84\") pod \"node-ca-6cjn4\" (UID: \"a435ed1a-6236-422a-a2a8-ed4a5997cbe2\") " pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.166224 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.166204 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4h8q\" (UniqueName: \"kubernetes.io/projected/79265418-0732-4d6c-ade9-b49691f561d9-kube-api-access-h4h8q\") pod \"iptables-alerter-vmcvx\" (UID: \"79265418-0732-4d6c-ade9-b49691f561d9\") " pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.168794 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.168743 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf7nh\" (UniqueName: \"kubernetes.io/projected/43675326-e285-4684-b1a6-3ceaed111497-kube-api-access-nf7nh\") pod \"tuned-4m792\" (UID: \"43675326-e285-4684-b1a6-3ceaed111497\") " pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.235350 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.235312 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kd28" Jul 23 19:01:15.244399 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.244362 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:15.253581 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.253554 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:15.260648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.260623 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4m792" Jul 23 19:01:15.268945 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.268923 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" Jul 23 19:01:15.277157 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.277126 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cjn4" Jul 23 19:01:15.289826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.289803 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6msx" Jul 23 19:01:15.298834 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.298814 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" Jul 23 19:01:15.306750 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.306728 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vmcvx" Jul 23 19:01:15.368056 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.368022 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 19:01:15.557009 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.556912 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:15.557009 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.556976 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:15.557239 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.557080 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:15.557239 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.557086 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:15.557239 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.557137 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:16.557122625 +0000 UTC m=+3.981120801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:15.557239 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.557151 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:01:16.557145124 +0000 UTC m=+3.981143296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:15.657832 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:15.657792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:15.658015 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.657963 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:15.658015 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.657987 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:15.658015 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.658001 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:15.658209 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:15.658074 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:16.658051711 +0000 UTC m=+4.082049904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:16.001555 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:16.001453 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:56:15 +0000 UTC" deadline="2028-05-05 11:56:41.741674976 +0000 UTC" Jul 23 19:01:16.001555 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:16.001497 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15640h55m25.740182257s" Jul 23 19:01:16.247355 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.247319 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79265418_0732_4d6c_ade9_b49691f561d9.slice/crio-8503842e2b2349b0f16c4e343b5dcd6016a8a167339d3a36f5cceb12019ce974 WatchSource:0}: Error finding container 8503842e2b2349b0f16c4e343b5dcd6016a8a167339d3a36f5cceb12019ce974: Status 404 returned error can't find the container with id 8503842e2b2349b0f16c4e343b5dcd6016a8a167339d3a36f5cceb12019ce974 Jul 23 19:01:16.249284 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.249261 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b6853a_9473_4fa0_b811_f7f71c3a0bbd.slice/crio-da4d42360d5d5e5c7206fe63d842e0feee4536ef12f798dfd44359511a0bc18c WatchSource:0}: Error finding container da4d42360d5d5e5c7206fe63d842e0feee4536ef12f798dfd44359511a0bc18c: Status 404 returned error can't find the container with id da4d42360d5d5e5c7206fe63d842e0feee4536ef12f798dfd44359511a0bc18c Jul 23 19:01:16.253961 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.253940 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9e4424_1675_4d06_84dc_c92e423de55e.slice/crio-9d237a8c17bbf8d563c8bbec14b8bf389817cbf2ffa8d02022a34c68f33ab5a3 WatchSource:0}: Error finding container 9d237a8c17bbf8d563c8bbec14b8bf389817cbf2ffa8d02022a34c68f33ab5a3: Status 404 returned error can't find the container with id 9d237a8c17bbf8d563c8bbec14b8bf389817cbf2ffa8d02022a34c68f33ab5a3 Jul 23 19:01:16.254745 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.254722 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5a389d_3d26_4712_afd7_215689dd0aa1.slice/crio-e71bf2eb0cae2119b4010645d95beed1d1ba30bee8f5af0e4abd562ee4eba083 WatchSource:0}: Error finding container e71bf2eb0cae2119b4010645d95beed1d1ba30bee8f5af0e4abd562ee4eba083: Status 404 returned error can't find the container with id e71bf2eb0cae2119b4010645d95beed1d1ba30bee8f5af0e4abd562ee4eba083 Jul 23 19:01:16.255830 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.255774 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43675326_e285_4684_b1a6_3ceaed111497.slice/crio-d0649cf01d84f3edc38ff96c76c0cce4ad87ec62c58a1e6c567bba533847da1b WatchSource:0}: Error finding container d0649cf01d84f3edc38ff96c76c0cce4ad87ec62c58a1e6c567bba533847da1b: Status 404 returned error can't find the container with id d0649cf01d84f3edc38ff96c76c0cce4ad87ec62c58a1e6c567bba533847da1b Jul 23 19:01:16.259432 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.259404 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c011ca9_67c5_4965_9a90_8cc4058985f7.slice/crio-88e2b3715e092976a26493ac23a3d00f148bfae1c64338ce72b75c2a83fcfc9b WatchSource:0}: Error finding container 88e2b3715e092976a26493ac23a3d00f148bfae1c64338ce72b75c2a83fcfc9b: Status 404 returned error can't find the container with id 88e2b3715e092976a26493ac23a3d00f148bfae1c64338ce72b75c2a83fcfc9b Jul 23 19:01:16.262148 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.262119 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda435ed1a_6236_422a_a2a8_ed4a5997cbe2.slice/crio-824b7384c0c9fbe05a605f0ca49a2eabc899f785d2c9bdbd4384af29743e4125 WatchSource:0}: Error finding container 824b7384c0c9fbe05a605f0ca49a2eabc899f785d2c9bdbd4384af29743e4125: Status 404 returned error can't find the container with id 824b7384c0c9fbe05a605f0ca49a2eabc899f785d2c9bdbd4384af29743e4125 Jul 23 19:01:16.262768 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:01:16.262740 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f859d3_7891_4261_8bcc_7a0d3098f186.slice/crio-72d2ef4349cdb5b89edb336d2b9acc6d9317ff1d401ea533929ec28fbf3c15b5 WatchSource:0}: Error finding container 72d2ef4349cdb5b89edb336d2b9acc6d9317ff1d401ea533929ec28fbf3c15b5: Status 404 returned error can't find the container with id 72d2ef4349cdb5b89edb336d2b9acc6d9317ff1d401ea533929ec28fbf3c15b5 Jul 23 19:01:16.566767 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:16.566453 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:16.566767 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:16.566706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:16.566767 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.566622 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:16.567003 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.566811 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:18.566792835 +0000 UTC m=+5.990791010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:16.567003 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.566835 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:16.567003 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.566894 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:01:18.566879375 +0000 UTC m=+5.990877578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:16.667346 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:16.667303 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:16.667524 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.667501 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:16.667591 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.667529 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:16.667591 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.667542 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:16.667677 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:16.667601 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:18.667586228 +0000 UTC m=+6.091584417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:17.002519 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.002435 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:56:15 +0000 UTC" deadline="2027-12-25 13:38:18.257905994 +0000 UTC" Jul 23 19:01:17.002519 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.002464 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12474h37m1.255444967s" Jul 23 19:01:17.075607 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.074744 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:17.075607 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:17.074885 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:17.075607 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.075406 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:17.075607 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:17.075528 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:17.076266 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.076108 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:17.076266 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:17.076207 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:17.087580 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.087548 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" event={"ID":"6afd729819b14aa08ff5546801a18817","Type":"ContainerStarted","Data":"26487191239ff03427de17e9337bfff6b896feb455ae9641f7aa9170b03b24dc"} Jul 23 19:01:17.089805 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.089712 2569 generic.go:356] "Generic (PLEG): container finished" podID="dbf712eebfab4ddd93a32b2493fa8fed" containerID="0b1eef4000754799e12a73f444f10760cb16a56d7749f7f0329ea1fd0cbf0809" exitCode=0 Jul 23 19:01:17.089805 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.089746 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" event={"ID":"dbf712eebfab4ddd93a32b2493fa8fed","Type":"ContainerDied","Data":"0b1eef4000754799e12a73f444f10760cb16a56d7749f7f0329ea1fd0cbf0809"} Jul 23 19:01:17.092567 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.092329 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kd28" event={"ID":"d6f859d3-7891-4261-8bcc-7a0d3098f186","Type":"ContainerStarted","Data":"72d2ef4349cdb5b89edb336d2b9acc6d9317ff1d401ea533929ec28fbf3c15b5"} Jul 23 19:01:17.094007 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.093948 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" event={"ID":"4c011ca9-67c5-4965-9a90-8cc4058985f7","Type":"ContainerStarted","Data":"88e2b3715e092976a26493ac23a3d00f148bfae1c64338ce72b75c2a83fcfc9b"} Jul 23 19:01:17.095494 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.095452 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6msx" event={"ID":"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095","Type":"ContainerStarted","Data":"b835d566df7cf1f09786f6d4ab6c5caee031e411e26516af7597e6c89ae275fa"} Jul 23 19:01:17.096752 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.096727 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerStarted","Data":"e71bf2eb0cae2119b4010645d95beed1d1ba30bee8f5af0e4abd562ee4eba083"} Jul 23 19:01:17.098323 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.098274 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4m792" event={"ID":"43675326-e285-4684-b1a6-3ceaed111497","Type":"ContainerStarted","Data":"d0649cf01d84f3edc38ff96c76c0cce4ad87ec62c58a1e6c567bba533847da1b"} Jul 23 19:01:17.100557 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.100054 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-twdst" event={"ID":"7e9e4424-1675-4d06-84dc-c92e423de55e","Type":"ContainerStarted","Data":"9d237a8c17bbf8d563c8bbec14b8bf389817cbf2ffa8d02022a34c68f33ab5a3"} Jul 23 19:01:17.104373 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.104343 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cjn4" event={"ID":"a435ed1a-6236-422a-a2a8-ed4a5997cbe2","Type":"ContainerStarted","Data":"824b7384c0c9fbe05a605f0ca49a2eabc899f785d2c9bdbd4384af29743e4125"} Jul 23 19:01:17.106184 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.106159 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"da4d42360d5d5e5c7206fe63d842e0feee4536ef12f798dfd44359511a0bc18c"} Jul 23 19:01:17.107660 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.107602 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" podStartSLOduration=3.10758708 podStartE2EDuration="3.10758708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:17.107333427 +0000 UTC m=+4.531331626" watchObservedRunningTime="2026-07-23 19:01:17.10758708 +0000 UTC m=+4.531585278" Jul 23 19:01:17.108015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:17.107981 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vmcvx" event={"ID":"79265418-0732-4d6c-ade9-b49691f561d9","Type":"ContainerStarted","Data":"8503842e2b2349b0f16c4e343b5dcd6016a8a167339d3a36f5cceb12019ce974"} Jul 23 19:01:18.128888 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:18.128850 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" event={"ID":"dbf712eebfab4ddd93a32b2493fa8fed","Type":"ContainerStarted","Data":"37ab59999b1f639951b81cd0f1e6d2515feee395c389f1e09e54757cf74c33cd"} Jul 23 19:01:18.591003 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:18.590909 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:18.591177 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:18.591010 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:18.591177 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.591150 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:18.591317 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.591215 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:22.591195189 +0000 UTC m=+10.015193376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:18.591791 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.591650 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:18.591791 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.591706 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:01:22.591690421 +0000 UTC m=+10.015688608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:18.692242 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:18.692196 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:18.692428 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.692397 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:18.692428 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.692417 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:18.692428 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.692430 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:18.692590 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:18.692492 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:22.692472736 +0000 UTC m=+10.116470912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:19.074484 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:19.074386 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:19.074484 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:19.074401 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:19.074717 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:19.074529 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:19.074717 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:19.074533 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:19.074717 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:19.074655 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:19.074887 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:19.074763 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:21.075186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:21.074401 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:21.075186 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:21.074558 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:21.075186 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:21.074969 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:21.075186 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:21.075075 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:21.076090 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:21.075905 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:21.076090 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:21.076005 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:22.632180 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:22.632141 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:22.632648 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.632316 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:22.632648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:22.632325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:22.632648 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.632388 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:01:30.63237029 +0000 UTC m=+18.056368474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:22.632648 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.632449 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:22.632648 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.632506 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:30.632489199 +0000 UTC m=+18.056487387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:22.733317 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:22.733281 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:22.733459 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.733439 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:22.733459 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.733457 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:22.733557 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.733470 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:22.733557 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:22.733536 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:30.733517055 +0000 UTC m=+18.157515230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:23.074404 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:23.074320 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:23.074404 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:23.074346 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:23.074626 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:23.074446 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:23.074626 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:23.074321 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:23.074626 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:23.074588 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:23.074770 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:23.074674 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:25.073552 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:25.073516 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:25.074029 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:25.073559 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:25.074029 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:25.073521 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:25.081162 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:25.080201 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:25.081162 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:25.080356 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:25.081162 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:25.080492 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:27.073570 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:27.073540 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:27.074042 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:27.073542 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:27.074042 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:27.073664 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:27.074042 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:27.073550 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:27.074042 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:27.073755 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:27.074042 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:27.073806 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:29.077493 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:29.077458 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:29.077959 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:29.077570 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:29.077959 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:29.077589 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:29.077959 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:29.077690 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:29.077959 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:29.077738 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:29.077959 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:29.077787 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:30.694478 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:30.694432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:30.694969 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:30.694495 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:30.694969 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.694610 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:30.694969 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.694694 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:46.694671805 +0000 UTC m=+34.118669978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:30.694969 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.694610 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:30.694969 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.694781 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:01:46.69476009 +0000 UTC m=+34.118758263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:30.795583 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:30.795541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:30.795751 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.795691 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:30.795751 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.795716 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:30.795751 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.795730 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:30.795866 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:30.795787 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:01:46.795771777 +0000 UTC m=+34.219769949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:31.073914 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:31.073836 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:31.074075 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:31.073836 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:31.074075 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:31.073958 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:31.074075 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:31.073974 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:31.074252 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:31.074088 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:31.074252 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:31.074152 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:33.074457 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:33.074413 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:33.074924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:33.074525 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:33.074924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:33.074549 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:33.074924 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:33.074523 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:33.074924 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:33.074650 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:33.074924 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:33.074758 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:35.077660 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:35.077632 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:35.078098 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:35.077747 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:35.078098 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:35.077752 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:35.078098 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:35.077751 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:35.078098 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:35.077884 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:35.078098 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:35.077927 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:36.181118 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.180667 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" event={"ID":"4c011ca9-67c5-4965-9a90-8cc4058985f7","Type":"ContainerStarted","Data":"a0e8494566c282d79535857532fec374f05403cb3bba83d70b5e0a2cee6be0a9"} Jul 23 19:01:36.182122 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.182092 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6msx" event={"ID":"b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095","Type":"ContainerStarted","Data":"14448f47ad4cfe0814055d7c84a1befe3f665d1a89eaf89a6d0c503d5ae8cf9c"} Jul 23 19:01:36.183535 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.183504 2569 generic.go:356] "Generic (PLEG): container finished" podID="9b5a389d-3d26-4712-afd7-215689dd0aa1" containerID="ffd43d8781b4f1905e5a2dbad91be35019ca942a6ce58cba363872e6284054e9" exitCode=0 Jul 23 19:01:36.183609 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.183554 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerDied","Data":"ffd43d8781b4f1905e5a2dbad91be35019ca942a6ce58cba363872e6284054e9"} Jul 23 19:01:36.185037 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.185013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4m792" event={"ID":"43675326-e285-4684-b1a6-3ceaed111497","Type":"ContainerStarted","Data":"e9f21e5a5ae4124a51ebd5fe403d33e47d35bb97596d1d67e2babd1b0b60869a"} Jul 23 19:01:36.186616 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.186499 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-twdst" event={"ID":"7e9e4424-1675-4d06-84dc-c92e423de55e","Type":"ContainerStarted","Data":"b706b0e970475e46949d5c02d7bdf680e465de9a8a1b5ec32ef8bfe146ce287a"} Jul 23 19:01:36.187865 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.187844 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cjn4" event={"ID":"a435ed1a-6236-422a-a2a8-ed4a5997cbe2","Type":"ContainerStarted","Data":"53ea5501bab86271b576a93090e2577397a97190f6e4e54473294fb29ff4b090"} Jul 23 19:01:36.191063 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.191036 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"f0178e6197e7b7d5fcc8af303d51f840a926b42dda731b61a83d796dc9ba9922"} Jul 23 19:01:36.191141 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.191096 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"1539c72641fafcbd402a98164410d09a590090cbe0b8d5eb5e7da87e61693f25"} Jul 23 19:01:36.191185 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.191139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"cc439443198a4b34361a3e7633e92e76bd365a6dbc23922242dd874548d56aec"} Jul 23 19:01:36.191185 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.191181 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"6d9c46aaebb4e4c73dacb089f1ebb568688bc500a21a4fe5525d7d0f698d5a96"} Jul 23 19:01:36.191290 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.191210 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"fe4ffade0ccf28c9efd1e3f9c5df3b7400b8ef6531bf9742c244809c39765a28"} Jul 23 19:01:36.191290 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.191257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"102cb0e252d4266eef73f01136a7c013b586f4f20649deecfcc875d114b6b4e9"} Jul 23 19:01:36.192415 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.192397 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kd28" event={"ID":"d6f859d3-7891-4261-8bcc-7a0d3098f186","Type":"ContainerStarted","Data":"08cef492f9bc47ec4cfc2815724eefdcfd44e291f4a6e0860be3e3735edf8329"} Jul 23 19:01:36.205204 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.205159 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p6msx" podStartSLOduration=4.18367023 podStartE2EDuration="23.20514694s" totalImagesPullingTime="19.02147671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:36.205104736 +0000 UTC m=+23.629102929" watchObservedRunningTime="2026-07-23 19:01:36.20514694 +0000 UTC m=+23.629145126" Jul 23 19:01:36.205361 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.205291 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" podStartSLOduration=22.205285133 podStartE2EDuration="22.205285133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:18.152460069 +0000 UTC m=+5.576458265" watchObservedRunningTime="2026-07-23 19:01:36.205285133 +0000 UTC m=+23.629283324" Jul 23 19:01:36.225800 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.225745 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-twdst" podStartSLOduration=4.200424427 podStartE2EDuration="23.225727624s" totalImagesPullingTime="19.025303197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:36.224850722 +0000 UTC m=+23.648848926" watchObservedRunningTime="2026-07-23 19:01:36.225727624 +0000 UTC m=+23.649725815" Jul 23 19:01:36.268588 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.268533 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6cjn4" podStartSLOduration=8.002777815 podStartE2EDuration="23.26851746s" totalImagesPullingTime="15.265739645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:36.246696582 +0000 UTC m=+23.670694774" watchObservedRunningTime="2026-07-23 19:01:36.26851746 +0000 UTC m=+23.692515646" Jul 23 19:01:36.268890 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.268871 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4m792" podStartSLOduration=4.243570452 podStartE2EDuration="23.26886615s" totalImagesPullingTime="19.025295698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:36.268345559 +0000 UTC m=+23.692343751" watchObservedRunningTime="2026-07-23 19:01:36.26886615 +0000 UTC m=+23.692864341" Jul 23 19:01:36.335358 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:36.334485 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7kd28" podStartSLOduration=4.258441606 podStartE2EDuration="23.334464614s" totalImagesPullingTime="19.076023008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:36.332026237 +0000 UTC m=+23.756024428" watchObservedRunningTime="2026-07-23 19:01:36.334464614 +0000 UTC m=+23.758462811" Jul 23 19:01:37.074373 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:37.074332 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:37.074373 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:37.074373 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:37.074687 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:37.074335 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:37.074687 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:37.074466 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:37.074687 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:37.074529 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:37.074687 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:37.074626 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:37.196242 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:37.196182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vmcvx" event={"ID":"79265418-0732-4d6c-ade9-b49691f561d9","Type":"ContainerStarted","Data":"9e4879c56f0a0e34dca281352cfa8effb76de0b18f1e3f23394f81e7c927e270"} Jul 23 19:01:37.215187 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:37.215135 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vmcvx" podStartSLOduration=5.184006514 podStartE2EDuration="24.215120259s" totalImagesPullingTime="19.031113745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:37.214574027 +0000 UTC m=+24.638572210" watchObservedRunningTime="2026-07-23 19:01:37.215120259 +0000 UTC m=+24.639118451" Jul 23 19:01:39.077577 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:39.077546 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:39.078056 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:39.077663 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:39.078056 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:39.077672 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:39.078056 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:39.077783 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:39.078056 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:39.077829 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:39.078056 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:39.077902 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:39.205439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:39.205400 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"ab8d52d76d3b8918c351ab291f186af4059529b29e20d4148eea20bcd55ed0eb"} Jul 23 19:01:40.229371 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:40.229332 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:40.230235 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:40.230202 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:40.473979 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:40.473445 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 19:01:41.016926 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.016825 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T19:01:40.473679257Z","UUID":"fa65044c-bbac-44ad-be4c-55d5d3451669","Handler":null,"Name":"","Endpoint":""} Jul 23 19:01:41.019751 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.019724 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 19:01:41.019867 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.019762 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 19:01:41.074258 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.074178 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:41.074258 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.074189 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:41.074451 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:41.074291 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:41.074451 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:41.074341 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:41.074451 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.074403 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:41.074580 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:41.074502 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:41.214029 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.213990 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" event={"ID":"a6b6853a-9473-4fa0-b811-f7f71c3a0bbd","Type":"ContainerStarted","Data":"e667460609f026a1923bc77fa19118f34b6fbc9775e7e9bcb83815b630501c4b"} Jul 23 19:01:41.214215 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.214148 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:41.216168 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.216139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" event={"ID":"4c011ca9-67c5-4965-9a90-8cc4058985f7","Type":"ContainerStarted","Data":"3ed8f235e1ff889a097e18fdb0964785a83345979960be32cc50e0ffdb442c6a"} Jul 23 19:01:41.218294 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.218241 2569 generic.go:356] "Generic (PLEG): container finished" podID="9b5a389d-3d26-4712-afd7-215689dd0aa1" containerID="044429a2a9c1a969289c0478254b5489218ac35cd74728f26909e2da6cb52c5d" exitCode=0 Jul 23 19:01:41.218400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.218316 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerDied","Data":"044429a2a9c1a969289c0478254b5489218ac35cd74728f26909e2da6cb52c5d"} Jul 23 19:01:41.231607 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.231586 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:41.254015 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.253975 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" podStartSLOduration=9.164118119 podStartE2EDuration="28.253960804s" totalImagesPullingTime="19.089842685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:41.252691252 +0000 UTC m=+28.676689446" watchObservedRunningTime="2026-07-23 19:01:41.253960804 +0000 UTC m=+28.677958995" Jul 23 19:01:41.559544 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:41.559368 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:42.171376 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.171353 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:42.172069 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.172017 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-twdst" Jul 23 19:01:42.222881 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.222850 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" event={"ID":"4c011ca9-67c5-4965-9a90-8cc4058985f7","Type":"ContainerStarted","Data":"71512124fda3e3873468a64ab8d55978bddad9bfde7b7f24d4dacd538e5b1ed0"} Jul 23 19:01:42.223630 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.223602 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:42.238437 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.238411 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:01:42.249672 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.249631 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56rzk" podStartSLOduration=3.87837969 podStartE2EDuration="29.249609298s" totalImagesPullingTime="25.371229608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:42.249264955 +0000 UTC m=+29.673263146" watchObservedRunningTime="2026-07-23 19:01:42.249609298 +0000 UTC m=+29.673607490" Jul 23 19:01:42.408894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.408859 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54n5t"] Jul 23 19:01:42.409058 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.408982 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:42.409122 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:42.409085 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:42.415680 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.415562 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p7m6"] Jul 23 19:01:42.415680 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.415675 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:42.415884 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:42.415776 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:42.416251 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.416208 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7nsr"] Jul 23 19:01:42.416357 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:42.416316 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:42.416455 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:42.416394 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:43.667760 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:43.667732 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6msx_b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095/dns-node-resolver/0.log" Jul 23 19:01:44.073819 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:44.073789 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:44.073954 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:44.073789 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:44.073954 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:44.073900 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:44.074029 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:44.073789 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:44.074029 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:44.073974 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:44.074101 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:44.074061 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:44.229564 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:44.229483 2569 generic.go:356] "Generic (PLEG): container finished" podID="9b5a389d-3d26-4712-afd7-215689dd0aa1" containerID="594e4ea9a311290644953e6987d7bfe7f436beab8a7c29527062b4eb73992393" exitCode=0 Jul 23 19:01:44.229728 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:44.229560 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerDied","Data":"594e4ea9a311290644953e6987d7bfe7f436beab8a7c29527062b4eb73992393"} Jul 23 19:01:44.630762 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:44.630735 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cjn4_a435ed1a-6236-422a-a2a8-ed4a5997cbe2/node-ca/0.log" Jul 23 19:01:46.074403 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.074150 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:46.074756 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.074152 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:46.074756 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.074437 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:46.074756 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.074152 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:46.074756 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.074492 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:46.074756 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.074563 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:46.235945 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.235914 2569 generic.go:356] "Generic (PLEG): container finished" podID="9b5a389d-3d26-4712-afd7-215689dd0aa1" containerID="eab6a2bce1099e2f7a659a584dce26099c2054c30350f19044f203d59854ac9e" exitCode=0 Jul 23 19:01:46.236087 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.235975 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerDied","Data":"eab6a2bce1099e2f7a659a584dce26099c2054c30350f19044f203d59854ac9e"} Jul 23 19:01:46.708672 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.708644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:46.708847 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.708684 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:46.708847 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.708773 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:46.708847 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.708781 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:46.708847 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.708819 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret podName:6d852daa-548b-42b9-a2ec-5a5003ac0cff nodeName:}" failed. No retries permitted until 2026-07-23 19:02:18.708807532 +0000 UTC m=+66.132805702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret") pod "global-pull-secret-syncer-8p7m6" (UID: "6d852daa-548b-42b9-a2ec-5a5003ac0cff") : object "kube-system"/"original-pull-secret" not registered Jul 23 19:01:46.708847 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.708833 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs podName:6ee4d10f-99a8-4c3b-927d-ee45bdfd7302 nodeName:}" failed. No retries permitted until 2026-07-23 19:02:18.708827233 +0000 UTC m=+66.132825403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs") pod "network-metrics-daemon-k7nsr" (UID: "6ee4d10f-99a8-4c3b-927d-ee45bdfd7302") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 19:01:46.809426 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:46.809394 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:46.809568 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.809551 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 19:01:46.809646 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.809571 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 19:01:46.809646 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.809581 2569 projected.go:196] Error preparing data for projected volume kube-api-access-j62b4 for pod openshift-network-diagnostics/network-check-target-54n5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:46.809646 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:46.809637 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4 podName:27b73529-7bd0-4cab-86e1-2a1c3962bcc5 nodeName:}" failed. No retries permitted until 2026-07-23 19:02:18.809622819 +0000 UTC m=+66.233620993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j62b4" (UniqueName: "kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4") pod "network-check-target-54n5t" (UID: "27b73529-7bd0-4cab-86e1-2a1c3962bcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 19:01:48.073823 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:48.073751 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:48.073823 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:48.073768 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:48.074431 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:48.073873 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:48.074431 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:48.073880 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:48.074431 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:48.073953 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:48.074431 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:48.074040 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:50.073915 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:50.073870 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:50.073915 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:50.073892 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:50.074513 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:50.073995 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:50.074513 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:50.074039 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:50.074513 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:50.074139 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:50.074513 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:50.074237 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:51.249071 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:51.249041 2569 generic.go:356] "Generic (PLEG): container finished" podID="9b5a389d-3d26-4712-afd7-215689dd0aa1" containerID="aa97af1fb3bbe52af194b0ec0b4ba8aa1e554dcc89163a7526f9016a00ed49d9" exitCode=0 Jul 23 19:01:51.249537 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:51.249088 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerDied","Data":"aa97af1fb3bbe52af194b0ec0b4ba8aa1e554dcc89163a7526f9016a00ed49d9"} Jul 23 19:01:52.073174 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:52.073147 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:52.073174 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:52.073171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:52.073366 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:52.073149 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:52.073366 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:52.073260 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:52.073366 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:52.073323 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:52.073459 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:52.073382 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:52.254542 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:52.254460 2569 generic.go:356] "Generic (PLEG): container finished" podID="9b5a389d-3d26-4712-afd7-215689dd0aa1" containerID="4d229181c1fc8881eef1e5d80b28d9f2bdf4b9193af1c5cecb3efb5d348cde46" exitCode=0 Jul 23 19:01:52.254542 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:52.254509 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerDied","Data":"4d229181c1fc8881eef1e5d80b28d9f2bdf4b9193af1c5cecb3efb5d348cde46"} Jul 23 19:01:53.259748 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:53.259710 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" event={"ID":"9b5a389d-3d26-4712-afd7-215689dd0aa1","Type":"ContainerStarted","Data":"bbe1c2cdf8ad3b12b7cd650652751ae511ea222480693cf5abb9ff29bb13126b"} Jul 23 19:01:53.286737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:53.286693 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lhqvp" podStartSLOduration=8.829292322 podStartE2EDuration="40.286678575s" totalImagesPullingTime="31.457386253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:01:53.286264361 +0000 UTC m=+40.710262553" watchObservedRunningTime="2026-07-23 19:01:53.286678575 +0000 UTC m=+40.710676767" Jul 23 19:01:54.074145 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:54.074109 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:54.074145 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:54.074138 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:54.074378 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:54.074138 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:54.074378 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:54.074208 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:54.074378 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:54.074316 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:54.074378 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:54.074369 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:56.073578 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:56.073540 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:56.073954 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:56.073587 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:56.073954 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:56.073587 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:56.073954 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:56.073654 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:01:56.073954 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:56.073739 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:56.073954 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:56.073800 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:58.074215 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:58.074176 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:01:58.074215 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:58.074202 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:01:58.074737 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:58.074298 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:01:58.074737 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:58.074337 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:01:58.074737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:01:58.074385 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:01:58.074737 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:01:58.074438 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:02:00.074011 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:00.073965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:00.074426 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:00.073974 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:02:00.074426 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:00.074189 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:02:00.074426 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:00.074076 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:02:00.074426 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:00.073986 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:02:00.074426 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:00.074283 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:02:02.073566 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:02.073531 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:02:02.073958 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:02.073636 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:02.073958 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:02.073645 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7nsr" podUID="6ee4d10f-99a8-4c3b-927d-ee45bdfd7302" Jul 23 19:02:02.073958 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:02.073663 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:02:02.073958 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:02.073731 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54n5t" podUID="27b73529-7bd0-4cab-86e1-2a1c3962bcc5" Jul 23 19:02:02.073958 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:02.073791 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p7m6" podUID="6d852daa-548b-42b9-a2ec-5a5003ac0cff" Jul 23 19:02:03.837261 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.837210 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeReady" Jul 23 19:02:03.837683 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.837366 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 19:02:03.870797 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.870770 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeReady" Jul 23 19:02:03.952127 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.952091 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pbh9x"] Jul 23 19:02:03.966714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.966691 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7hmlc"] Jul 23 19:02:03.966843 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.966827 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:03.979542 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.979524 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 19:02:03.979704 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.979689 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 19:02:03.980360 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.980347 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbh9x"] Jul 23 19:02:03.980435 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.980425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:03.981609 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.981588 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 19:02:03.982512 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.982495 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cdq4c\"" Jul 23 19:02:03.986059 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.986037 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 19:02:03.986294 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.986280 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 19:02:03.987111 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.987059 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7hmlc"] Jul 23 19:02:03.987111 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.987093 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 19:02:03.987295 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.987130 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kngdw\"" Jul 23 19:02:03.987295 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:03.987157 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 19:02:04.027526 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.027453 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cs9kh"] Jul 23 19:02:04.032370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032347 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd893597-7523-46c3-886b-675a283d18d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.032474 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032385 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd893597-7523-46c3-886b-675a283d18d6-crio-socket\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.032474 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxw22\" (UniqueName: \"kubernetes.io/projected/dd893597-7523-46c3-886b-675a283d18d6-kube-api-access-cxw22\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.032474 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032450 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd893597-7523-46c3-886b-675a283d18d6-data-volume\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.032474 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032471 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf27936-9b11-416c-92b9-61753d41a9ee-cert\") pod \"ingress-canary-7hmlc\" (UID: \"7bf27936-9b11-416c-92b9-61753d41a9ee\") " pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.032619 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jx2z\" (UniqueName: \"kubernetes.io/projected/7bf27936-9b11-416c-92b9-61753d41a9ee-kube-api-access-8jx2z\") pod \"ingress-canary-7hmlc\" (UID: \"7bf27936-9b11-416c-92b9-61753d41a9ee\") " pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.032619 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.032531 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd893597-7523-46c3-886b-675a283d18d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.052550 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.052526 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cs9kh"] Jul 23 19:02:04.052650 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.052621 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.057441 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.057380 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fgf46\"" Jul 23 19:02:04.057885 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.057867 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 19:02:04.057885 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.057878 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 19:02:04.073989 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.073971 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:04.074102 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.074051 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:02:04.074167 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.074146 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:02:04.077418 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.077397 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 19:02:04.077525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.077475 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 19:02:04.077920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.077896 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v8qs8\"" Jul 23 19:02:04.078038 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.078022 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 19:02:04.080536 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.080518 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 19:02:04.080629 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.080609 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5ztj\"" Jul 23 19:02:04.133494 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133467 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58kks\" (UniqueName: \"kubernetes.io/projected/7fbae762-dc10-43e9-88ad-f2ee75af2c67-kube-api-access-58kks\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.133614 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133533 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fbae762-dc10-43e9-88ad-f2ee75af2c67-config-volume\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.133614 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fbae762-dc10-43e9-88ad-f2ee75af2c67-metrics-tls\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.133614 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd893597-7523-46c3-886b-675a283d18d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.133726 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbae762-dc10-43e9-88ad-f2ee75af2c67-tmp-dir\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.133726 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd893597-7523-46c3-886b-675a283d18d6-crio-socket\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.133726 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxw22\" (UniqueName: \"kubernetes.io/projected/dd893597-7523-46c3-886b-675a283d18d6-kube-api-access-cxw22\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.133852 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133729 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd893597-7523-46c3-886b-675a283d18d6-data-volume\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.133852 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133760 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf27936-9b11-416c-92b9-61753d41a9ee-cert\") pod \"ingress-canary-7hmlc\" (UID: \"7bf27936-9b11-416c-92b9-61753d41a9ee\") " pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.133852 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133785 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jx2z\" (UniqueName: \"kubernetes.io/projected/7bf27936-9b11-416c-92b9-61753d41a9ee-kube-api-access-8jx2z\") pod \"ingress-canary-7hmlc\" (UID: \"7bf27936-9b11-416c-92b9-61753d41a9ee\") " pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.133993 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133892 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd893597-7523-46c3-886b-675a283d18d6-crio-socket\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.134046 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.133991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd893597-7523-46c3-886b-675a283d18d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.134130 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.134098 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd893597-7523-46c3-886b-675a283d18d6-data-volume\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.134593 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.134574 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd893597-7523-46c3-886b-675a283d18d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.137495 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.137478 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd893597-7523-46c3-886b-675a283d18d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.137653 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.137637 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf27936-9b11-416c-92b9-61753d41a9ee-cert\") pod \"ingress-canary-7hmlc\" (UID: \"7bf27936-9b11-416c-92b9-61753d41a9ee\") " pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.142293 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.142273 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jx2z\" (UniqueName: \"kubernetes.io/projected/7bf27936-9b11-416c-92b9-61753d41a9ee-kube-api-access-8jx2z\") pod \"ingress-canary-7hmlc\" (UID: \"7bf27936-9b11-416c-92b9-61753d41a9ee\") " pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.143780 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.143763 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxw22\" (UniqueName: \"kubernetes.io/projected/dd893597-7523-46c3-886b-675a283d18d6-kube-api-access-cxw22\") pod \"insights-runtime-extractor-pbh9x\" (UID: \"dd893597-7523-46c3-886b-675a283d18d6\") " pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.234980 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.234942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58kks\" (UniqueName: \"kubernetes.io/projected/7fbae762-dc10-43e9-88ad-f2ee75af2c67-kube-api-access-58kks\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.235151 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.234997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fbae762-dc10-43e9-88ad-f2ee75af2c67-config-volume\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.235151 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.235013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fbae762-dc10-43e9-88ad-f2ee75af2c67-metrics-tls\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.235151 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.235127 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbae762-dc10-43e9-88ad-f2ee75af2c67-tmp-dir\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.235498 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.235469 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbae762-dc10-43e9-88ad-f2ee75af2c67-tmp-dir\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.235690 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.235668 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fbae762-dc10-43e9-88ad-f2ee75af2c67-config-volume\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.237310 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.237290 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fbae762-dc10-43e9-88ad-f2ee75af2c67-metrics-tls\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.244441 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.244421 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58kks\" (UniqueName: \"kubernetes.io/projected/7fbae762-dc10-43e9-88ad-f2ee75af2c67-kube-api-access-58kks\") pod \"dns-default-cs9kh\" (UID: \"7fbae762-dc10-43e9-88ad-f2ee75af2c67\") " pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.275360 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.275332 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbh9x" Jul 23 19:02:04.289800 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.289745 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7hmlc" Jul 23 19:02:04.361199 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.361134 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:04.484066 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.484035 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7hmlc"] Jul 23 19:02:04.489880 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.489772 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbh9x"] Jul 23 19:02:04.498090 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:04.498065 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd893597_7523_46c3_886b_675a283d18d6.slice/crio-0d46927b39e88364675e3fac3d661f9d81db7ae04f7c24dc78e5eca0e30ccdca WatchSource:0}: Error finding container 0d46927b39e88364675e3fac3d661f9d81db7ae04f7c24dc78e5eca0e30ccdca: Status 404 returned error can't find the container with id 0d46927b39e88364675e3fac3d661f9d81db7ae04f7c24dc78e5eca0e30ccdca Jul 23 19:02:04.523063 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:04.523026 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cs9kh"] Jul 23 19:02:04.526029 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:04.526004 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbae762_dc10_43e9_88ad_f2ee75af2c67.slice/crio-568d60daa855ca08a4b6d9fff71ff6a2d2760b6cf7a07dd367df6a04457b14b2 WatchSource:0}: Error finding container 568d60daa855ca08a4b6d9fff71ff6a2d2760b6cf7a07dd367df6a04457b14b2: Status 404 returned error can't find the container with id 568d60daa855ca08a4b6d9fff71ff6a2d2760b6cf7a07dd367df6a04457b14b2 Jul 23 19:02:05.221024 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.220990 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c4f6b48cf-jfccc"] Jul 23 19:02:05.242683 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.242651 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.246745 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.246685 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4f6b48cf-jfccc"] Jul 23 19:02:05.247056 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.247036 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8s5vh\"" Jul 23 19:02:05.248525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.247746 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 19:02:05.248525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.248013 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 19:02:05.248525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.248152 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 19:02:05.248525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.248253 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 19:02:05.248525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.248364 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 19:02:05.248525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.248483 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 19:02:05.248852 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.248792 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 19:02:05.287157 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.287058 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cs9kh" event={"ID":"7fbae762-dc10-43e9-88ad-f2ee75af2c67","Type":"ContainerStarted","Data":"568d60daa855ca08a4b6d9fff71ff6a2d2760b6cf7a07dd367df6a04457b14b2"} Jul 23 19:02:05.288884 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.288840 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7hmlc" event={"ID":"7bf27936-9b11-416c-92b9-61753d41a9ee","Type":"ContainerStarted","Data":"34528ce58c4e9334b7a58a424144af96c500678dec2d9c44587a6dc60bd78d84"} Jul 23 19:02:05.290371 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.290344 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbh9x" event={"ID":"dd893597-7523-46c3-886b-675a283d18d6","Type":"ContainerStarted","Data":"0d46927b39e88364675e3fac3d661f9d81db7ae04f7c24dc78e5eca0e30ccdca"} Jul 23 19:02:05.345786 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.345754 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-oauth-config\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.345786 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.345789 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-service-ca\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.346026 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.345857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-serving-cert\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.346026 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.345900 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9grtf\" (UniqueName: \"kubernetes.io/projected/69f8cca5-c287-428d-925a-1fb6b3b659c7-kube-api-access-9grtf\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.346026 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.345980 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-config\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.346164 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.346033 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-oauth-serving-cert\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.446742 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.446701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-serving-cert\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.446920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.446786 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9grtf\" (UniqueName: \"kubernetes.io/projected/69f8cca5-c287-428d-925a-1fb6b3b659c7-kube-api-access-9grtf\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.446920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.446831 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-config\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.446920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.446857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-oauth-serving-cert\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.446920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.446910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-oauth-config\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.447128 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.446929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-service-ca\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.447855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.447799 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-config\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.448112 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.448088 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-oauth-serving-cert\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.448695 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.448671 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-service-ca\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.451404 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.451381 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-serving-cert\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.451721 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.451703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-oauth-config\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.457980 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.457956 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9grtf\" (UniqueName: \"kubernetes.io/projected/69f8cca5-c287-428d-925a-1fb6b3b659c7-kube-api-access-9grtf\") pod \"console-5c4f6b48cf-jfccc\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.559196 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.559113 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:05.755661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:05.755630 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4f6b48cf-jfccc"] Jul 23 19:02:05.760492 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:05.760442 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f8cca5_c287_428d_925a_1fb6b3b659c7.slice/crio-ca9944fe8e4a73f23ca4f859e35bd3f6a3403f9773984f82070cc5c21e9d46d0 WatchSource:0}: Error finding container ca9944fe8e4a73f23ca4f859e35bd3f6a3403f9773984f82070cc5c21e9d46d0: Status 404 returned error can't find the container with id ca9944fe8e4a73f23ca4f859e35bd3f6a3403f9773984f82070cc5c21e9d46d0 Jul 23 19:02:06.295561 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:06.295514 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4f6b48cf-jfccc" event={"ID":"69f8cca5-c287-428d-925a-1fb6b3b659c7","Type":"ContainerStarted","Data":"ca9944fe8e4a73f23ca4f859e35bd3f6a3403f9773984f82070cc5c21e9d46d0"} Jul 23 19:02:07.577504 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.577465 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6658f9bc6-jhhjw"] Jul 23 19:02:07.595653 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.595626 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6658f9bc6-jhhjw"] Jul 23 19:02:07.595827 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.595736 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.603807 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.603781 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 19:02:07.665546 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-console-config\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.665724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665563 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-serving-cert\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.665724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665589 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-trusted-ca-bundle\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.665724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-service-ca\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.665858 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665714 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-oauth-serving-cert\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.665858 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665825 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq86m\" (UniqueName: \"kubernetes.io/projected/f82125a5-eb5e-451d-9cda-d687442a69b9-kube-api-access-jq86m\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.665938 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.665869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-oauth-config\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766534 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766491 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-service-ca\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766718 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766558 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-oauth-serving-cert\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766718 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq86m\" (UniqueName: \"kubernetes.io/projected/f82125a5-eb5e-451d-9cda-d687442a69b9-kube-api-access-jq86m\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766718 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766676 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-oauth-config\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766718 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-console-config\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766970 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-serving-cert\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.766970 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.766754 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-trusted-ca-bundle\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.767534 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.767269 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-service-ca\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.767803 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.767750 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-oauth-serving-cert\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.767922 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.767858 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-console-config\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.768207 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.768186 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-trusted-ca-bundle\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.769853 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.769824 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-serving-cert\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.769964 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.769855 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-oauth-config\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.778034 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.778009 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq86m\" (UniqueName: \"kubernetes.io/projected/f82125a5-eb5e-451d-9cda-d687442a69b9-kube-api-access-jq86m\") pod \"console-6658f9bc6-jhhjw\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:07.907169 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:07.907092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:11.999654 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:11.999559 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6658f9bc6-jhhjw"] Jul 23 19:02:12.009417 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:12.009048 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82125a5_eb5e_451d_9cda_d687442a69b9.slice/crio-955391df86f85db30e6d3554d0e80744de250552b81b48ee7613774e6eba1960 WatchSource:0}: Error finding container 955391df86f85db30e6d3554d0e80744de250552b81b48ee7613774e6eba1960: Status 404 returned error can't find the container with id 955391df86f85db30e6d3554d0e80744de250552b81b48ee7613774e6eba1960 Jul 23 19:02:12.311777 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.311734 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4f6b48cf-jfccc" event={"ID":"69f8cca5-c287-428d-925a-1fb6b3b659c7","Type":"ContainerStarted","Data":"0251ef57753bb5d24295c3e49ff1f4d93a2edfe344c367a7714cb991446e8089"} Jul 23 19:02:12.313192 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.313167 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658f9bc6-jhhjw" event={"ID":"f82125a5-eb5e-451d-9cda-d687442a69b9","Type":"ContainerStarted","Data":"6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5"} Jul 23 19:02:12.313345 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.313208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658f9bc6-jhhjw" event={"ID":"f82125a5-eb5e-451d-9cda-d687442a69b9","Type":"ContainerStarted","Data":"955391df86f85db30e6d3554d0e80744de250552b81b48ee7613774e6eba1960"} Jul 23 19:02:12.314604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.314582 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbh9x" event={"ID":"dd893597-7523-46c3-886b-675a283d18d6","Type":"ContainerStarted","Data":"4ce5e45c27fbdf823648cd95215dfe98c74d70d48474c67e4825ad2eaad42657"} Jul 23 19:02:12.316236 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.316202 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cs9kh" event={"ID":"7fbae762-dc10-43e9-88ad-f2ee75af2c67","Type":"ContainerStarted","Data":"1180c5a93539c2a36900ccb249ddc543580870a308d41c40ceb33e16c687ba10"} Jul 23 19:02:12.316330 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.316268 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cs9kh" event={"ID":"7fbae762-dc10-43e9-88ad-f2ee75af2c67","Type":"ContainerStarted","Data":"0a74815421f4ffbae0dc324baf15d1ae66a750c8b6a8a67716cb9535b10690b5"} Jul 23 19:02:12.316330 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.316291 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:12.317541 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.317521 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7hmlc" event={"ID":"7bf27936-9b11-416c-92b9-61753d41a9ee","Type":"ContainerStarted","Data":"79cede1555dc93de4cbd4c7d1f70a85cdde74afca01761631328cedb919bd55c"} Jul 23 19:02:12.333088 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.333044 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c4f6b48cf-jfccc" podStartSLOduration=1.244155333 podStartE2EDuration="7.333029889s" totalImagesPullingTime="6.088874556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:12.332045007 +0000 UTC m=+59.756043223" watchObservedRunningTime="2026-07-23 19:02:12.333029889 +0000 UTC m=+59.757028124" Jul 23 19:02:12.351552 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.351512 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cs9kh" podStartSLOduration=1.027926296 podStartE2EDuration="8.351500169s" totalImagesPullingTime="7.323573873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:12.350992158 +0000 UTC m=+59.774990354" watchObservedRunningTime="2026-07-23 19:02:12.351500169 +0000 UTC m=+59.775498339" Jul 23 19:02:12.368767 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.368726 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7hmlc" podStartSLOduration=2.009628299 podStartE2EDuration="9.368712778s" totalImagesPullingTime="7.359084479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:12.367644088 +0000 UTC m=+59.791642280" watchObservedRunningTime="2026-07-23 19:02:12.368712778 +0000 UTC m=+59.792710969" Jul 23 19:02:12.400111 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:12.400006 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6658f9bc6-jhhjw" podStartSLOduration=5.399988101 podStartE2EDuration="5.399988101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:12.399493408 +0000 UTC m=+59.823491642" watchObservedRunningTime="2026-07-23 19:02:12.399988101 +0000 UTC m=+59.823986294" Jul 23 19:02:13.782296 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.782266 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc"] Jul 23 19:02:13.789147 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.789117 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:13.792487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.792461 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 19:02:13.792595 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.792472 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ffcbm\"" Jul 23 19:02:13.810658 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.810603 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc"] Jul 23 19:02:13.817825 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.817799 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a83d0b49-ea2a-4284-8aac-8c95560d6a1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rlgsc\" (UID: \"a83d0b49-ea2a-4284-8aac-8c95560d6a1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:13.918502 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:13.918468 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a83d0b49-ea2a-4284-8aac-8c95560d6a1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rlgsc\" (UID: \"a83d0b49-ea2a-4284-8aac-8c95560d6a1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:13.918678 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:13.918613 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 23 19:02:13.918727 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:13.918699 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83d0b49-ea2a-4284-8aac-8c95560d6a1f-tls-certificates podName:a83d0b49-ea2a-4284-8aac-8c95560d6a1f nodeName:}" failed. No retries permitted until 2026-07-23 19:02:14.418675821 +0000 UTC m=+61.842673996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a83d0b49-ea2a-4284-8aac-8c95560d6a1f-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-rlgsc" (UID: "a83d0b49-ea2a-4284-8aac-8c95560d6a1f") : secret "prometheus-operator-admission-webhook-tls" not found Jul 23 19:02:14.245837 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:14.245809 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5vwg" Jul 23 19:02:14.422419 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:14.422380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a83d0b49-ea2a-4284-8aac-8c95560d6a1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rlgsc\" (UID: \"a83d0b49-ea2a-4284-8aac-8c95560d6a1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:14.425041 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:14.425014 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a83d0b49-ea2a-4284-8aac-8c95560d6a1f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rlgsc\" (UID: \"a83d0b49-ea2a-4284-8aac-8c95560d6a1f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:14.699089 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:14.699055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:15.559774 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:15.559739 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:15.560156 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:15.559797 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:15.561215 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:15.561188 2569 patch_prober.go:28] interesting pod/console-5c4f6b48cf-jfccc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 23 19:02:15.561333 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:15.561250 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c4f6b48cf-jfccc" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 23 19:02:15.966633 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:15.966598 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc"] Jul 23 19:02:15.969463 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:15.969436 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83d0b49_ea2a_4284_8aac_8c95560d6a1f.slice/crio-13d13a22fbb4d8e3ccd23fd8950626ad83cea19017fdcb5a1b67e0bf5dcc43f5 WatchSource:0}: Error finding container 13d13a22fbb4d8e3ccd23fd8950626ad83cea19017fdcb5a1b67e0bf5dcc43f5: Status 404 returned error can't find the container with id 13d13a22fbb4d8e3ccd23fd8950626ad83cea19017fdcb5a1b67e0bf5dcc43f5 Jul 23 19:02:16.332310 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:16.332271 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" event={"ID":"a83d0b49-ea2a-4284-8aac-8c95560d6a1f","Type":"ContainerStarted","Data":"13d13a22fbb4d8e3ccd23fd8950626ad83cea19017fdcb5a1b67e0bf5dcc43f5"} Jul 23 19:02:16.333848 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:16.333826 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbh9x" event={"ID":"dd893597-7523-46c3-886b-675a283d18d6","Type":"ContainerStarted","Data":"71f6203d0899f89d5330677ff48e4146b9952aae292a2ac25e925aa453c11900"} Jul 23 19:02:17.339131 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.339089 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" event={"ID":"a83d0b49-ea2a-4284-8aac-8c95560d6a1f","Type":"ContainerStarted","Data":"b755cddf2f0106cd63cbc37af9fdd776caef2797678ab070ca02cc0df0e74894"} Jul 23 19:02:17.339612 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.339391 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:17.344653 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.344623 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" Jul 23 19:02:17.364153 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.364094 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rlgsc" podStartSLOduration=3.117779368 podStartE2EDuration="4.364075516s" totalImagesPullingTime="1.246296148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:17.36281197 +0000 UTC m=+64.786810163" watchObservedRunningTime="2026-07-23 19:02:17.364075516 +0000 UTC m=+64.788073743" Jul 23 19:02:17.873286 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.873250 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd"] Jul 23 19:02:17.875661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.875636 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:17.879741 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.879716 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 19:02:17.879988 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.879925 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vs8mv\"" Jul 23 19:02:17.880103 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.879994 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 23 19:02:17.880103 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.880008 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 19:02:17.880290 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.880267 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 23 19:02:17.880398 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.880352 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 19:02:17.889264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.889244 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd"] Jul 23 19:02:17.907371 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.907343 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:17.907517 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.907403 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:17.908667 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.908645 2569 patch_prober.go:28] interesting pod/console-6658f9bc6-jhhjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Jul 23 19:02:17.908779 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.908689 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6658f9bc6-jhhjw" podUID="f82125a5-eb5e-451d-9cda-d687442a69b9" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Jul 23 19:02:17.953836 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.953773 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:17.954023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.953935 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5v7b\" (UniqueName: \"kubernetes.io/projected/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-kube-api-access-r5v7b\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:17.954023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.954005 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:17.954146 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:17.954084 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.055446 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.055405 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.055648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.055479 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5v7b\" (UniqueName: \"kubernetes.io/projected/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-kube-api-access-r5v7b\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.055648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.055528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.055769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.055692 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.056320 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.056291 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.058196 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.058175 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.058416 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.058393 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.065878 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.065849 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5v7b\" (UniqueName: \"kubernetes.io/projected/d781789b-f050-4b85-a4fb-1dbaa8c5cd76-kube-api-access-r5v7b\") pod \"prometheus-operator-5945b5cfd-fbtnd\" (UID: \"d781789b-f050-4b85-a4fb-1dbaa8c5cd76\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.185922 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.185889 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" Jul 23 19:02:18.763978 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.763941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:02:18.764398 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.764022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:02:18.766850 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.766807 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 19:02:18.766973 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.766859 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 19:02:18.777530 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.777503 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee4d10f-99a8-4c3b-927d-ee45bdfd7302-metrics-certs\") pod \"network-metrics-daemon-k7nsr\" (UID: \"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302\") " pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:02:18.777670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.777567 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d852daa-548b-42b9-a2ec-5a5003ac0cff-original-pull-secret\") pod \"global-pull-secret-syncer-8p7m6\" (UID: \"6d852daa-548b-42b9-a2ec-5a5003ac0cff\") " pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:02:18.790760 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.790729 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p7m6" Jul 23 19:02:18.797341 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.797316 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5ztj\"" Jul 23 19:02:18.805473 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.805442 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7nsr" Jul 23 19:02:18.864600 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.864565 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:18.867292 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.867266 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 19:02:18.877570 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.877548 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 19:02:18.888028 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:18.888003 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j62b4\" (UniqueName: \"kubernetes.io/projected/27b73529-7bd0-4cab-86e1-2a1c3962bcc5-kube-api-access-j62b4\") pod \"network-check-target-54n5t\" (UID: \"27b73529-7bd0-4cab-86e1-2a1c3962bcc5\") " pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:19.087143 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:19.087063 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v8qs8\"" Jul 23 19:02:19.094721 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:19.094692 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:19.650878 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:19.650846 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54n5t"] Jul 23 19:02:19.654376 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:19.654347 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b73529_7bd0_4cab_86e1_2a1c3962bcc5.slice/crio-cd0eb7e0da4548bad0b7c66425c375cd81616909e67b813d157c35539c305ae6 WatchSource:0}: Error finding container cd0eb7e0da4548bad0b7c66425c375cd81616909e67b813d157c35539c305ae6: Status 404 returned error can't find the container with id cd0eb7e0da4548bad0b7c66425c375cd81616909e67b813d157c35539c305ae6 Jul 23 19:02:19.871064 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:19.870994 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd"] Jul 23 19:02:19.874446 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:19.874401 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd781789b_f050_4b85_a4fb_1dbaa8c5cd76.slice/crio-ba7ac92959a1502ee82d7c2f5eb2b34a0f278d334c59b33eed17bcb11b31860e WatchSource:0}: Error finding container ba7ac92959a1502ee82d7c2f5eb2b34a0f278d334c59b33eed17bcb11b31860e: Status 404 returned error can't find the container with id ba7ac92959a1502ee82d7c2f5eb2b34a0f278d334c59b33eed17bcb11b31860e Jul 23 19:02:19.874567 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:19.874454 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p7m6"] Jul 23 19:02:19.877183 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:19.877160 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7nsr"] Jul 23 19:02:19.878157 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:19.878089 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d852daa_548b_42b9_a2ec_5a5003ac0cff.slice/crio-69848cc03c2588e50f095796f1c5607552e10b8cb88b8edfafb6e68613f63a1f WatchSource:0}: Error finding container 69848cc03c2588e50f095796f1c5607552e10b8cb88b8edfafb6e68613f63a1f: Status 404 returned error can't find the container with id 69848cc03c2588e50f095796f1c5607552e10b8cb88b8edfafb6e68613f63a1f Jul 23 19:02:19.880818 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:19.880782 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee4d10f_99a8_4c3b_927d_ee45bdfd7302.slice/crio-4df4d2c1c5e8f41ba1d2ca7b6a7edbea4ebcc9103f820ec22881c540dd3c0462 WatchSource:0}: Error finding container 4df4d2c1c5e8f41ba1d2ca7b6a7edbea4ebcc9103f820ec22881c540dd3c0462: Status 404 returned error can't find the container with id 4df4d2c1c5e8f41ba1d2ca7b6a7edbea4ebcc9103f820ec22881c540dd3c0462 Jul 23 19:02:20.355524 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:20.355438 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbh9x" event={"ID":"dd893597-7523-46c3-886b-675a283d18d6","Type":"ContainerStarted","Data":"fff2255c0b98212247dc21f9063d923fd1c6b0d5a4229178e49866864a9249da"} Jul 23 19:02:20.356823 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:20.356782 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7nsr" event={"ID":"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302","Type":"ContainerStarted","Data":"4df4d2c1c5e8f41ba1d2ca7b6a7edbea4ebcc9103f820ec22881c540dd3c0462"} Jul 23 19:02:20.358121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:20.358072 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54n5t" event={"ID":"27b73529-7bd0-4cab-86e1-2a1c3962bcc5","Type":"ContainerStarted","Data":"cd0eb7e0da4548bad0b7c66425c375cd81616909e67b813d157c35539c305ae6"} Jul 23 19:02:20.359315 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:20.359291 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p7m6" event={"ID":"6d852daa-548b-42b9-a2ec-5a5003ac0cff","Type":"ContainerStarted","Data":"69848cc03c2588e50f095796f1c5607552e10b8cb88b8edfafb6e68613f63a1f"} Jul 23 19:02:20.364486 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:20.364399 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" event={"ID":"d781789b-f050-4b85-a4fb-1dbaa8c5cd76","Type":"ContainerStarted","Data":"ba7ac92959a1502ee82d7c2f5eb2b34a0f278d334c59b33eed17bcb11b31860e"} Jul 23 19:02:22.323439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:22.323374 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cs9kh" Jul 23 19:02:22.346370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:22.346308 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pbh9x" podStartSLOduration=4.484768977 podStartE2EDuration="19.346285425s" totalImagesPullingTime="14.861516448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:02:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:20.376440934 +0000 UTC m=+67.800439129" watchObservedRunningTime="2026-07-23 19:02:22.346285425 +0000 UTC m=+69.770283594" Jul 23 19:02:22.376249 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:22.376186 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" event={"ID":"d781789b-f050-4b85-a4fb-1dbaa8c5cd76","Type":"ContainerStarted","Data":"01b202e2df66b7c5e884c560147e59e31eaf1ec935fa29254b633a4e09fad8fa"} Jul 23 19:02:22.376437 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:22.376277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" event={"ID":"d781789b-f050-4b85-a4fb-1dbaa8c5cd76","Type":"ContainerStarted","Data":"85fe2e634729da684fa2dbb4d666a28d86cb9d933a562d68237671e11cc0f239"} Jul 23 19:02:22.395967 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:22.395906 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fbtnd" podStartSLOduration=3.836343281 podStartE2EDuration="5.395882454s" totalImagesPullingTime="1.559539173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:22.395274104 +0000 UTC m=+69.819272303" watchObservedRunningTime="2026-07-23 19:02:22.395882454 +0000 UTC m=+69.819880649" Jul 23 19:02:24.341002 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.340961 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb"] Jul 23 19:02:24.343706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.343683 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.355768 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.355750 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wpkkl\"" Jul 23 19:02:24.355892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.355747 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 19:02:24.356086 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.356067 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 19:02:24.398659 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.398616 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-9c5v8"] Jul 23 19:02:24.401241 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.401203 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.407740 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.407716 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 19:02:24.407740 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.407739 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 19:02:24.407924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.407887 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-27mg8\"" Jul 23 19:02:24.411281 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.411259 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 19:02:24.413925 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.413897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61ce1cb9-da85-4856-a021-6e7f9e523e8f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.414025 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.413956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ce1cb9-da85-4856-a021-6e7f9e523e8f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.414025 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.414004 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72p7x\" (UniqueName: \"kubernetes.io/projected/61ce1cb9-da85-4856-a021-6e7f9e523e8f-kube-api-access-72p7x\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.414122 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.414037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ce1cb9-da85-4856-a021-6e7f9e523e8f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.416252 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.416211 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pnjsr"] Jul 23 19:02:24.418778 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.418760 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.421086 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.420972 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b6jgk\"" Jul 23 19:02:24.421263 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.421242 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 19:02:24.421850 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.421831 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 19:02:24.422517 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.422499 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 19:02:24.433537 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.433514 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb"] Jul 23 19:02:24.465974 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.465942 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-9c5v8"] Jul 23 19:02:24.515033 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515002 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ce1cb9-da85-4856-a021-6e7f9e523e8f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.515172 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515051 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/925a85c3-606c-4005-99eb-e383dc2bac1f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.515172 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515086 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-wtmp\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515172 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515108 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d21cfbb-1349-45fa-8e1d-d2a360a10611-metrics-client-ca\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515172 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.515349 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515252 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-textfile\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515349 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515349 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5z4j\" (UniqueName: \"kubernetes.io/projected/7d21cfbb-1349-45fa-8e1d-d2a360a10611-kube-api-access-k5z4j\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515467 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-accelerators-collector-config\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515467 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515407 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925a85c3-606c-4005-99eb-e383dc2bac1f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.515467 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-root\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515467 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515458 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61ce1cb9-da85-4856-a021-6e7f9e523e8f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.515628 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515489 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.515628 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-tls\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515628 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515531 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ce1cb9-da85-4856-a021-6e7f9e523e8f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.515628 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515582 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-sys\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.515817 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515713 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.515817 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72p7x\" (UniqueName: \"kubernetes.io/projected/61ce1cb9-da85-4856-a021-6e7f9e523e8f-kube-api-access-72p7x\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.515817 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.515804 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvpv\" (UniqueName: \"kubernetes.io/projected/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-api-access-4tvpv\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.516286 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.516263 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ce1cb9-da85-4856-a021-6e7f9e523e8f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.517923 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.517899 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ce1cb9-da85-4856-a021-6e7f9e523e8f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.518033 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.517924 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61ce1cb9-da85-4856-a021-6e7f9e523e8f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.526399 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.526345 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72p7x\" (UniqueName: \"kubernetes.io/projected/61ce1cb9-da85-4856-a021-6e7f9e523e8f-kube-api-access-72p7x\") pod \"openshift-state-metrics-79f6958cdf-99rwb\" (UID: \"61ce1cb9-da85-4856-a021-6e7f9e523e8f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.616877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.616831 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.617008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.616878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvpv\" (UniqueName: \"kubernetes.io/projected/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-api-access-4tvpv\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.617008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.616920 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/925a85c3-606c-4005-99eb-e383dc2bac1f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.617008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.616962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-wtmp\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.616985 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d21cfbb-1349-45fa-8e1d-d2a360a10611-metrics-client-ca\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617007 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-textfile\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617058 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617083 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5z4j\" (UniqueName: \"kubernetes.io/projected/7d21cfbb-1349-45fa-8e1d-d2a360a10611-kube-api-access-k5z4j\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-accelerators-collector-config\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925a85c3-606c-4005-99eb-e383dc2bac1f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.617213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617178 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-root\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.617592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617316 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-tls\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617354 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-sys\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617474 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-sys\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617494 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-wtmp\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617510 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-textfile\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.617917 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.617873 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/925a85c3-606c-4005-99eb-e383dc2bac1f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.619382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.618110 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-accelerators-collector-config\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.619382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.618110 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d21cfbb-1349-45fa-8e1d-d2a360a10611-root\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.619382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.618698 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d21cfbb-1349-45fa-8e1d-d2a360a10611-metrics-client-ca\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.619382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.618804 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925a85c3-606c-4005-99eb-e383dc2bac1f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.619382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.619129 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.619828 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.619802 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.620605 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.620546 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.621468 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.621420 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-tls\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.621737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.621714 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d21cfbb-1349-45fa-8e1d-d2a360a10611-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.626894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.626843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5z4j\" (UniqueName: \"kubernetes.io/projected/7d21cfbb-1349-45fa-8e1d-d2a360a10611-kube-api-access-k5z4j\") pod \"node-exporter-pnjsr\" (UID: \"7d21cfbb-1349-45fa-8e1d-d2a360a10611\") " pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.626894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.626856 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvpv\" (UniqueName: \"kubernetes.io/projected/925a85c3-606c-4005-99eb-e383dc2bac1f-kube-api-access-4tvpv\") pod \"kube-state-metrics-56c5594674-9c5v8\" (UID: \"925a85c3-606c-4005-99eb-e383dc2bac1f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.654218 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.654185 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" Jul 23 19:02:24.712523 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.712447 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" Jul 23 19:02:24.729405 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.729177 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pnjsr" Jul 23 19:02:24.827609 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.827191 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb"] Jul 23 19:02:24.870621 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:24.870592 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-9c5v8"] Jul 23 19:02:24.873915 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:24.873890 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925a85c3_606c_4005_99eb_e383dc2bac1f.slice/crio-3d4c93151cbfb580ab1e09d8be4a06aff8d8f773b583f4683878f78f8f79e5b5 WatchSource:0}: Error finding container 3d4c93151cbfb580ab1e09d8be4a06aff8d8f773b583f4683878f78f8f79e5b5: Status 404 returned error can't find the container with id 3d4c93151cbfb580ab1e09d8be4a06aff8d8f773b583f4683878f78f8f79e5b5 Jul 23 19:02:25.390721 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.390645 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p7m6" event={"ID":"6d852daa-548b-42b9-a2ec-5a5003ac0cff","Type":"ContainerStarted","Data":"7fbf00a4dfb8c7cb5b329356d279309b1bad9a1ff540cc63edd215eccfdbeff8"} Jul 23 19:02:25.392424 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.392397 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" event={"ID":"925a85c3-606c-4005-99eb-e383dc2bac1f","Type":"ContainerStarted","Data":"3d4c93151cbfb580ab1e09d8be4a06aff8d8f773b583f4683878f78f8f79e5b5"} Jul 23 19:02:25.394409 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.394382 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" event={"ID":"61ce1cb9-da85-4856-a021-6e7f9e523e8f","Type":"ContainerStarted","Data":"145d3fabc94eb8ff8e9b2939a04b3ddbd4d0fe055cd33b80c6365743c1f8307e"} Jul 23 19:02:25.394521 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.394436 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" event={"ID":"61ce1cb9-da85-4856-a021-6e7f9e523e8f","Type":"ContainerStarted","Data":"112d80b39f2cd7ce0f17271320a1ddde97c4457362c1be79a6583846ef6904ba"} Jul 23 19:02:25.394521 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.394464 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" event={"ID":"61ce1cb9-da85-4856-a021-6e7f9e523e8f","Type":"ContainerStarted","Data":"3e67a680061ca1a58cd0944d0e20bd977ee5ecec75c1490604e1de65746dc188"} Jul 23 19:02:25.396471 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.396434 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7nsr" event={"ID":"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302","Type":"ContainerStarted","Data":"86e26cf3dddbc30da58a33d13f0b99a0b4307a0f0a5cb34dea0672f70a455d45"} Jul 23 19:02:25.396589 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.396482 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7nsr" event={"ID":"6ee4d10f-99a8-4c3b-927d-ee45bdfd7302","Type":"ContainerStarted","Data":"76d936622fd8b183cbe63ca8644ea37f1c9654985f6d42d0d37f80eaa46340e4"} Jul 23 19:02:25.398246 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.398198 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54n5t" event={"ID":"27b73529-7bd0-4cab-86e1-2a1c3962bcc5","Type":"ContainerStarted","Data":"ec7d7f27badbc93cca601fb56c0078a9d85d204aebea00e3f47f9cbe37512ae9"} Jul 23 19:02:25.398333 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.398281 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:02:25.399440 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.399422 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnjsr" event={"ID":"7d21cfbb-1349-45fa-8e1d-d2a360a10611","Type":"ContainerStarted","Data":"8888a711def1549fa120bbb37c07f75c93c423d134dfb9526973b9988acd5f95"} Jul 23 19:02:25.410165 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.409778 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8p7m6" podStartSLOduration=67.796273135 podStartE2EDuration="1m12.409756243s" totalImagesPullingTime="4.613483108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:25.40924839 +0000 UTC m=+72.833246583" watchObservedRunningTime="2026-07-23 19:02:25.409756243 +0000 UTC m=+72.833754436" Jul 23 19:02:25.430537 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.430497 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 19:02:25.431682 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.431625 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-54n5t" podStartSLOduration=67.594322753 podStartE2EDuration="1m12.431601818s" totalImagesPullingTime="4.837279065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:25.430990338 +0000 UTC m=+72.854988530" watchObservedRunningTime="2026-07-23 19:02:25.431601818 +0000 UTC m=+72.855600036" Jul 23 19:02:25.433453 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.433435 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.435793 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.435759 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 19:02:25.435793 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.435773 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 19:02:25.435971 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.435777 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 19:02:25.436258 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.436219 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 19:02:25.436391 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.436382 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 19:02:25.436503 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.436487 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 19:02:25.436637 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.436615 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 19:02:25.436866 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.436846 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 19:02:25.436977 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.436959 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2xskw\"" Jul 23 19:02:25.437134 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.437116 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 19:02:25.453795 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.453765 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 19:02:25.465669 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.465611 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k7nsr" podStartSLOduration=67.824595572 podStartE2EDuration="1m12.465594767s" totalImagesPullingTime="4.640999195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:25.464905377 +0000 UTC m=+72.888903573" watchObservedRunningTime="2026-07-23 19:02:25.465594767 +0000 UTC m=+72.889592960" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525270 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525320 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994f9335-0d86-4f92-b26d-e4c4bf409036-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525354 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/994f9335-0d86-4f92-b26d-e4c4bf409036-config-out\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525385 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/994f9335-0d86-4f92-b26d-e4c4bf409036-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525436 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525527 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525571 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/994f9335-0d86-4f92-b26d-e4c4bf409036-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525628 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/994f9335-0d86-4f92-b26d-e4c4bf409036-tls-assets\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525685 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-config-volume\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525759 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whtmk\" (UniqueName: \"kubernetes.io/projected/994f9335-0d86-4f92-b26d-e4c4bf409036-kube-api-access-whtmk\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.526014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.525791 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-web-config\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.559591 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.559548 2569 patch_prober.go:28] interesting pod/console-5c4f6b48cf-jfccc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 23 19:02:25.559757 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.559610 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c4f6b48cf-jfccc" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 23 19:02:25.626418 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626418 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994f9335-0d86-4f92-b26d-e4c4bf409036-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626452 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/994f9335-0d86-4f92-b26d-e4c4bf409036-config-out\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626484 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/994f9335-0d86-4f92-b26d-e4c4bf409036-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/994f9335-0d86-4f92-b26d-e4c4bf409036-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626638 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/994f9335-0d86-4f92-b26d-e4c4bf409036-tls-assets\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.626662 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626666 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.627032 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-config-volume\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.627032 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whtmk\" (UniqueName: \"kubernetes.io/projected/994f9335-0d86-4f92-b26d-e4c4bf409036-kube-api-access-whtmk\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.627032 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.626724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-web-config\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.627854 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.627590 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/994f9335-0d86-4f92-b26d-e4c4bf409036-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.627854 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.627597 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/994f9335-0d86-4f92-b26d-e4c4bf409036-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.628849 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.628071 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/994f9335-0d86-4f92-b26d-e4c4bf409036-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.628849 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:25.628185 2569 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 23 19:02:25.628849 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:02:25.628264 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-main-tls podName:994f9335-0d86-4f92-b26d-e4c4bf409036 nodeName:}" failed. No retries permitted until 2026-07-23 19:02:26.128243602 +0000 UTC m=+73.552241773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "994f9335-0d86-4f92-b26d-e4c4bf409036") : secret "alertmanager-main-tls" not found Jul 23 19:02:25.629717 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.629668 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.630177 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.630127 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-web-config\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.630595 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.630570 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.630700 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.630573 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/994f9335-0d86-4f92-b26d-e4c4bf409036-tls-assets\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.630700 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.630673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.631188 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.631160 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/994f9335-0d86-4f92-b26d-e4c4bf409036-config-out\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.631641 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.631620 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-config-volume\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.632200 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.632176 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:25.640761 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:25.639416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whtmk\" (UniqueName: \"kubernetes.io/projected/994f9335-0d86-4f92-b26d-e4c4bf409036-kube-api-access-whtmk\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:26.130689 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.130648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:26.133489 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.133460 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/994f9335-0d86-4f92-b26d-e4c4bf409036-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"994f9335-0d86-4f92-b26d-e4c4bf409036\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:26.343673 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.343640 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 19:02:26.407273 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.406303 2569 generic.go:356] "Generic (PLEG): container finished" podID="7d21cfbb-1349-45fa-8e1d-d2a360a10611" containerID="4fa170dc3644cd3626af08c9dc56baed582714d6741fc4d33f5eea506b81183f" exitCode=0 Jul 23 19:02:26.407273 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.406682 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnjsr" event={"ID":"7d21cfbb-1349-45fa-8e1d-d2a360a10611","Type":"ContainerDied","Data":"4fa170dc3644cd3626af08c9dc56baed582714d6741fc4d33f5eea506b81183f"} Jul 23 19:02:26.409464 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.409392 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" event={"ID":"925a85c3-606c-4005-99eb-e383dc2bac1f","Type":"ContainerStarted","Data":"2a5cef9b4b173f43535adb4b34443504fe321ac786f2fa89f64af5f9ad456987"} Jul 23 19:02:26.450535 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.450499 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56597c4f44-xmxk4"] Jul 23 19:02:26.454431 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.454395 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.457904 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.457879 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 19:02:26.458078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.458052 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 19:02:26.458078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.458052 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 19:02:26.458409 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.458350 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 19:02:26.458409 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.458505 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rfrhl\"" Jul 23 19:02:26.458409 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.458767 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 19:02:26.459895 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.458999 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-evs28idbhms80\"" Jul 23 19:02:26.469463 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.469396 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56597c4f44-xmxk4"] Jul 23 19:02:26.533613 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.533846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-metrics-client-ca\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.533846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-tls\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.533846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533690 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.533846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533720 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.533846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdhtv\" (UniqueName: \"kubernetes.io/projected/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-kube-api-access-jdhtv\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.533846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.533766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.534336 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.534092 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-grpc-tls\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635519 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635490 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635614 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635546 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-metrics-client-ca\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635614 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635585 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-tls\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635730 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635730 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635642 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635730 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635669 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdhtv\" (UniqueName: \"kubernetes.io/projected/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-kube-api-access-jdhtv\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635730 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.635933 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.635791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-grpc-tls\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.637656 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.637166 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-metrics-client-ca\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.638773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.638726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.638984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.638937 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-grpc-tls\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.639745 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.639641 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.639745 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.639704 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.640123 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.640095 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-tls\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.640528 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.640505 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.645922 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.645882 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdhtv\" (UniqueName: \"kubernetes.io/projected/2b85c0c1-cc70-4b50-88f0-7104f3c2d88a-kube-api-access-jdhtv\") pod \"thanos-querier-56597c4f44-xmxk4\" (UID: \"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a\") " pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.736241 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.735908 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 19:02:26.738273 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:26.738243 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994f9335_0d86_4f92_b26d_e4c4bf409036.slice/crio-603afad10db3411e999f55c2cb8360411270fec0ad6b7b8a53d7b2488c688c06 WatchSource:0}: Error finding container 603afad10db3411e999f55c2cb8360411270fec0ad6b7b8a53d7b2488c688c06: Status 404 returned error can't find the container with id 603afad10db3411e999f55c2cb8360411270fec0ad6b7b8a53d7b2488c688c06 Jul 23 19:02:26.766469 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.766429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:26.915522 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:26.915496 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56597c4f44-xmxk4"] Jul 23 19:02:26.917858 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:26.917831 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b85c0c1_cc70_4b50_88f0_7104f3c2d88a.slice/crio-7a53dcce04e0380f498fa527056fb53daa2fea318003e4c90b36e8da6abce509 WatchSource:0}: Error finding container 7a53dcce04e0380f498fa527056fb53daa2fea318003e4c90b36e8da6abce509: Status 404 returned error can't find the container with id 7a53dcce04e0380f498fa527056fb53daa2fea318003e4c90b36e8da6abce509 Jul 23 19:02:27.420582 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.420544 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" event={"ID":"925a85c3-606c-4005-99eb-e383dc2bac1f","Type":"ContainerStarted","Data":"c4d19adb10b5ec0a2c057faeda92cb2610db318680822dc735225c5d6675ec88"} Jul 23 19:02:27.421146 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.421113 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" event={"ID":"925a85c3-606c-4005-99eb-e383dc2bac1f","Type":"ContainerStarted","Data":"9f1194407afc73de3abb32bcaafacb4549924d7a19ba06820b265f515d321a2f"} Jul 23 19:02:27.422405 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.422378 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"7a53dcce04e0380f498fa527056fb53daa2fea318003e4c90b36e8da6abce509"} Jul 23 19:02:27.425510 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.425434 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" event={"ID":"61ce1cb9-da85-4856-a021-6e7f9e523e8f","Type":"ContainerStarted","Data":"0d836e3557b8ca6b851a97bdf77fde1f8514b82879206f5b4953f5b8b91b7876"} Jul 23 19:02:27.428271 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.428212 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnjsr" event={"ID":"7d21cfbb-1349-45fa-8e1d-d2a360a10611","Type":"ContainerStarted","Data":"7f3902c6e4e83f0d667b9b1d7d0fdbb0c088b529dbd709eb4fca8d2d5fc93406"} Jul 23 19:02:27.428370 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.428278 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnjsr" event={"ID":"7d21cfbb-1349-45fa-8e1d-d2a360a10611","Type":"ContainerStarted","Data":"a59277016ccf8c5ae7d5a0525fa3350b79ef0fd1b0a8fdd50caeca7124343515"} Jul 23 19:02:27.429602 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.429581 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"603afad10db3411e999f55c2cb8360411270fec0ad6b7b8a53d7b2488c688c06"} Jul 23 19:02:27.444062 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.444007 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-9c5v8" podStartSLOduration=2.073462965 podStartE2EDuration="3.443989239s" totalImagesPullingTime="1.370526274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:27.441983792 +0000 UTC m=+74.865981996" watchObservedRunningTime="2026-07-23 19:02:27.443989239 +0000 UTC m=+74.867987432" Jul 23 19:02:27.467142 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.466654 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pnjsr" podStartSLOduration=2.434721045 podStartE2EDuration="3.466633545s" totalImagesPullingTime="951.794018ms" totalInitContainerRuntime="80.118482ms" isStatefulPod=true podCreationTimestamp="2026-07-23 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:27.466182425 +0000 UTC m=+74.890180628" watchObservedRunningTime="2026-07-23 19:02:27.466633545 +0000 UTC m=+74.890631738" Jul 23 19:02:27.491283 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.491201 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-99rwb" podStartSLOduration=1.835995247 podStartE2EDuration="3.491180234s" totalImagesPullingTime="1.655184987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:27.488863909 +0000 UTC m=+74.912862113" watchObservedRunningTime="2026-07-23 19:02:27.491180234 +0000 UTC m=+74.915178429" Jul 23 19:02:27.912871 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.912839 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:27.917868 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.917842 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:02:27.987343 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:27.987310 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4f6b48cf-jfccc"] Jul 23 19:02:28.436479 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.436442 2569 generic.go:356] "Generic (PLEG): container finished" podID="994f9335-0d86-4f92-b26d-e4c4bf409036" containerID="d111a187e7ee69f8a87163f604e49d68f6da17f36b85503d5b425728b35d4ab9" exitCode=0 Jul 23 19:02:28.436941 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.436555 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerDied","Data":"d111a187e7ee69f8a87163f604e49d68f6da17f36b85503d5b425728b35d4ab9"} Jul 23 19:02:28.764105 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.764024 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8588757d9b-w9j6r"] Jul 23 19:02:28.768672 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.768646 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.772425 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.772404 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dkvdf\"" Jul 23 19:02:28.772652 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.772622 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 19:02:28.772770 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.772701 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-82j0qjjojt8i4\"" Jul 23 19:02:28.772770 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.772746 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 19:02:28.772884 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.772786 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 19:02:28.772943 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.772908 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 19:02:28.780112 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.780088 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8588757d9b-w9j6r"] Jul 23 19:02:28.858126 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-secret-metrics-server-tls\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.858126 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-client-ca-bundle\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.858395 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b260f67b-78e1-4476-b69e-d5ccf6fb833d-metrics-server-audit-profiles\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.858395 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858303 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-secret-metrics-server-client-certs\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.858395 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b260f67b-78e1-4476-b69e-d5ccf6fb833d-audit-log\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.858540 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b260f67b-78e1-4476-b69e-d5ccf6fb833d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.858540 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.858458 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dr9g\" (UniqueName: \"kubernetes.io/projected/b260f67b-78e1-4476-b69e-d5ccf6fb833d-kube-api-access-4dr9g\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959097 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959073 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b260f67b-78e1-4476-b69e-d5ccf6fb833d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959189 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959103 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dr9g\" (UniqueName: \"kubernetes.io/projected/b260f67b-78e1-4476-b69e-d5ccf6fb833d-kube-api-access-4dr9g\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959189 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959131 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-secret-metrics-server-tls\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959189 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959156 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-client-ca-bundle\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959329 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959193 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b260f67b-78e1-4476-b69e-d5ccf6fb833d-metrics-server-audit-profiles\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959329 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959216 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-secret-metrics-server-client-certs\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.959329 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.959257 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b260f67b-78e1-4476-b69e-d5ccf6fb833d-audit-log\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.965206 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.960252 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b260f67b-78e1-4476-b69e-d5ccf6fb833d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.965206 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.960342 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b260f67b-78e1-4476-b69e-d5ccf6fb833d-audit-log\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.965206 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.960602 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b260f67b-78e1-4476-b69e-d5ccf6fb833d-metrics-server-audit-profiles\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.965206 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.962693 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-secret-metrics-server-tls\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.965206 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.962843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-client-ca-bundle\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.966155 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.966130 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b260f67b-78e1-4476-b69e-d5ccf6fb833d-secret-metrics-server-client-certs\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:28.971660 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:28.971639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dr9g\" (UniqueName: \"kubernetes.io/projected/b260f67b-78e1-4476-b69e-d5ccf6fb833d-kube-api-access-4dr9g\") pod \"metrics-server-8588757d9b-w9j6r\" (UID: \"b260f67b-78e1-4476-b69e-d5ccf6fb833d\") " pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:29.080108 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.080074 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:29.098593 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.098555 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt"] Jul 23 19:02:29.103600 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.103482 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.106084 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.105955 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-898l9\"" Jul 23 19:02:29.106178 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.105955 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 19:02:29.123671 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.123532 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt"] Jul 23 19:02:29.160611 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.160568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42d5b034-52d9-4f6d-b760-07fcf9bae93f-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7jzqt\" (UID: \"42d5b034-52d9-4f6d-b760-07fcf9bae93f\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.160719 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.160692 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4lb\" (UniqueName: \"kubernetes.io/projected/42d5b034-52d9-4f6d-b760-07fcf9bae93f-kube-api-access-ff4lb\") pod \"monitoring-plugin-7b7b7bc8bf-7jzqt\" (UID: \"42d5b034-52d9-4f6d-b760-07fcf9bae93f\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.252005 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.251966 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8588757d9b-w9j6r"] Jul 23 19:02:29.254138 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:29.254107 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb260f67b_78e1_4476_b69e_d5ccf6fb833d.slice/crio-dda545a8223ba85357b3e4294f4c4e212bb8fb02d1e9a13d487e33fa6af22924 WatchSource:0}: Error finding container dda545a8223ba85357b3e4294f4c4e212bb8fb02d1e9a13d487e33fa6af22924: Status 404 returned error can't find the container with id dda545a8223ba85357b3e4294f4c4e212bb8fb02d1e9a13d487e33fa6af22924 Jul 23 19:02:29.261325 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.261295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42d5b034-52d9-4f6d-b760-07fcf9bae93f-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7jzqt\" (UID: \"42d5b034-52d9-4f6d-b760-07fcf9bae93f\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.261440 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.261393 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4lb\" (UniqueName: \"kubernetes.io/projected/42d5b034-52d9-4f6d-b760-07fcf9bae93f-kube-api-access-ff4lb\") pod \"monitoring-plugin-7b7b7bc8bf-7jzqt\" (UID: \"42d5b034-52d9-4f6d-b760-07fcf9bae93f\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.264162 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.264136 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42d5b034-52d9-4f6d-b760-07fcf9bae93f-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7jzqt\" (UID: \"42d5b034-52d9-4f6d-b760-07fcf9bae93f\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.275185 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.275127 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4lb\" (UniqueName: \"kubernetes.io/projected/42d5b034-52d9-4f6d-b760-07fcf9bae93f-kube-api-access-ff4lb\") pod \"monitoring-plugin-7b7b7bc8bf-7jzqt\" (UID: \"42d5b034-52d9-4f6d-b760-07fcf9bae93f\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.415958 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.415912 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:29.449971 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.449930 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"9b7dec1dcd5f915bc4bf2a2628b76d0d448bc2998ab4884fa9aecaefbc88cf62"} Jul 23 19:02:29.450428 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.450015 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"5289bcf3e249d77caa67c43cbf63fbd4a1fcf98b30320c480517944933d78ce2"} Jul 23 19:02:29.450428 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.450057 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"00e0273a3500fbf0f6af4e2d8bfad3eab3e5dad016f7b263dd1067913ed8ba08"} Jul 23 19:02:29.452368 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.452217 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" event={"ID":"b260f67b-78e1-4476-b69e-d5ccf6fb833d","Type":"ContainerStarted","Data":"dda545a8223ba85357b3e4294f4c4e212bb8fb02d1e9a13d487e33fa6af22924"} Jul 23 19:02:29.581817 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:29.581794 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt"] Jul 23 19:02:29.584423 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:29.584392 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d5b034_52d9_4f6d_b760_07fcf9bae93f.slice/crio-0d601a9f50c16a3794357f2abc49be7bbab874affc87a8a848455965c3b77667 WatchSource:0}: Error finding container 0d601a9f50c16a3794357f2abc49be7bbab874affc87a8a848455965c3b77667: Status 404 returned error can't find the container with id 0d601a9f50c16a3794357f2abc49be7bbab874affc87a8a848455965c3b77667 Jul 23 19:02:30.450684 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.450654 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5f97477b-2zbdt"] Jul 23 19:02:30.455431 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.455035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.469104 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.468733 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"a68d2ffcdf4d85eceec6ff8e6f912a32939409f9eb65bd64e460df17e80b1f47"} Jul 23 19:02:30.469104 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.468797 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"c0d33154d3d20528a0ffc708f5d2b4cdd8d3cc5747594fbe25027a10f62ecf3f"} Jul 23 19:02:30.469104 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.468826 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" event={"ID":"2b85c0c1-cc70-4b50-88f0-7104f3c2d88a","Type":"ContainerStarted","Data":"59dd3233e04c545153890d4a38f6dc06ebc72df72cb6cbf595c0968a0827dfcd"} Jul 23 19:02:30.469104 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.468855 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:30.474208 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.473690 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5f97477b-2zbdt"] Jul 23 19:02:30.489242 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.489119 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"61df950b53ec476de49c17e1cc9425a40720c1fec4ca54288b58d8591c76295d"} Jul 23 19:02:30.489709 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.489497 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"67d0de86de9217aff9413eb83584b0671e7ff65a15a32b051e148cafa0cdf653"} Jul 23 19:02:30.489709 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.489554 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"8dffdde3c6ec38221efcc736d7e71a7b39d6d3a445b52c501fa631b0b7b10d6b"} Jul 23 19:02:30.489709 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.489592 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"26485ade1e5aabbc9c37bf2ae5845a86527ea4a6a7808a5db166d0ba4b535993"} Jul 23 19:02:30.492506 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.492466 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" event={"ID":"42d5b034-52d9-4f6d-b760-07fcf9bae93f","Type":"ContainerStarted","Data":"0d601a9f50c16a3794357f2abc49be7bbab874affc87a8a848455965c3b77667"} Jul 23 19:02:30.545254 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.544912 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" podStartSLOduration=1.4988875560000001 podStartE2EDuration="4.544892365s" totalImagesPullingTime="3.046004809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:30.543847925 +0000 UTC m=+77.967846195" watchObservedRunningTime="2026-07-23 19:02:30.544892365 +0000 UTC m=+77.968890559" Jul 23 19:02:30.573325 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573293 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-serving-cert\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.573435 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-oauth-serving-cert\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.573435 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573393 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp8bm\" (UniqueName: \"kubernetes.io/projected/d5795f1e-9201-4c39-9cee-fab19357fb87-kube-api-access-lp8bm\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.573515 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-service-ca\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.573515 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573499 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-trusted-ca-bundle\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.573577 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573524 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-oauth-config\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.573731 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.573715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-console-config\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674512 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674417 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-service-ca\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674512 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674498 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-trusted-ca-bundle\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674725 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674555 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-oauth-config\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674725 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-console-config\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674725 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674674 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-serving-cert\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674725 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674700 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-oauth-serving-cert\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.674925 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.674730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp8bm\" (UniqueName: \"kubernetes.io/projected/d5795f1e-9201-4c39-9cee-fab19357fb87-kube-api-access-lp8bm\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.675695 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.675647 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-console-config\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.676008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.675955 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-service-ca\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.676160 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.676112 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-oauth-serving-cert\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.676356 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.676307 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-trusted-ca-bundle\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.678170 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.678147 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-serving-cert\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.680379 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.680333 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-oauth-config\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.693489 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.693437 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp8bm\" (UniqueName: \"kubernetes.io/projected/d5795f1e-9201-4c39-9cee-fab19357fb87-kube-api-access-lp8bm\") pod \"console-5f5f97477b-2zbdt\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.769387 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.769297 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:30.923078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.921478 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 19:02:30.927514 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.927450 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:30.943261 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.942997 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 19:02:30.943891 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.943729 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 19:02:30.943891 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.943771 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.943962 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.944136 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.944398 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.944576 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.944734 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ct545hgj50ceq\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.944883 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.945046 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.945199 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.945373 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.945827 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7twcm\"" Jul 23 19:02:30.946400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.945994 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 19:02:30.955817 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.955798 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 19:02:30.956091 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.956027 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5f97477b-2zbdt"] Jul 23 19:02:30.962396 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:30.962373 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5795f1e_9201_4c39_9cee_fab19357fb87.slice/crio-366438b9b1b1bc5c63a2e10eab8ce46b0e479ba61ed3c4d403433ac048093954 WatchSource:0}: Error finding container 366438b9b1b1bc5c63a2e10eab8ce46b0e479ba61ed3c4d403433ac048093954: Status 404 returned error can't find the container with id 366438b9b1b1bc5c63a2e10eab8ce46b0e479ba61ed3c4d403433ac048093954 Jul 23 19:02:30.962629 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.962608 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 19:02:30.964279 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:30.964259 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 19:02:31.078839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.078802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.078839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.078840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079092 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.078868 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079092 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.078900 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079092 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.078920 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079092 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.078992 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079092 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079307 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079097 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079307 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079132 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079307 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079307 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079307 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079216 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079307 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079292 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079368 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-config\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079480 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079532 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079580 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.079838 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.079616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrt2\" (UniqueName: \"kubernetes.io/projected/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-kube-api-access-bcrt2\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180549 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180460 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180549 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180587 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180617 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180654 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180713 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-config\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.180769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180769 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180798 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrt2\" (UniqueName: \"kubernetes.io/projected/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-kube-api-access-bcrt2\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180928 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180955 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.180991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.181121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.182044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181189 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.182044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181389 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.182044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181552 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.182211 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.181965 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.182211 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.182172 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.182886 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.182859 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.183516 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.183493 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.183738 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.183711 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.185407 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.185356 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.185816 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.185794 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-config\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.186134 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.186109 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.186211 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.186143 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.186480 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.186437 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.186577 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.186556 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.186716 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.186691 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.187333 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.186951 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.187333 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.187292 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.187837 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.187816 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.187987 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.187958 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.194532 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.194508 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrt2\" (UniqueName: \"kubernetes.io/projected/85e3be41-a0e6-49e7-8ac0-e59cad4785cc-kube-api-access-bcrt2\") pod \"prometheus-k8s-0\" (UID: \"85e3be41-a0e6-49e7-8ac0-e59cad4785cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.277393 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.277354 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:31.503520 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.503474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f97477b-2zbdt" event={"ID":"d5795f1e-9201-4c39-9cee-fab19357fb87","Type":"ContainerStarted","Data":"1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d"} Jul 23 19:02:31.504009 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.503572 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f97477b-2zbdt" event={"ID":"d5795f1e-9201-4c39-9cee-fab19357fb87","Type":"ContainerStarted","Data":"366438b9b1b1bc5c63a2e10eab8ce46b0e479ba61ed3c4d403433ac048093954"} Jul 23 19:02:31.507485 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.507439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"a6c35d6f998812ca16065eaef700179f8feb393955089808c30db0bde42344a3"} Jul 23 19:02:31.507615 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.507531 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"994f9335-0d86-4f92-b26d-e4c4bf409036","Type":"ContainerStarted","Data":"11486a3e087de833707808949c59d8c80574a7463af72fd8d3f7c756d2d206d0"} Jul 23 19:02:31.546075 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.546008 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5f97477b-2zbdt" podStartSLOduration=1.545989025 podStartE2EDuration="1.545989025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:31.54465631 +0000 UTC m=+78.968654515" watchObservedRunningTime="2026-07-23 19:02:31.545989025 +0000 UTC m=+78.969987217" Jul 23 19:02:31.593847 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:31.593754 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.528106952 podStartE2EDuration="6.593732645s" totalImagesPullingTime="3.050228266s" totalInitContainerRuntime="15.397427ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:31.592010833 +0000 UTC m=+79.016009038" watchObservedRunningTime="2026-07-23 19:02:31.593732645 +0000 UTC m=+79.017730838" Jul 23 19:02:32.075076 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:02:32.075044 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e3be41_a0e6_49e7_8ac0_e59cad4785cc.slice/crio-e87f0aa5601a46e58a5952033ffd8e54d1951ebb70844ca471b505810118f857 WatchSource:0}: Error finding container e87f0aa5601a46e58a5952033ffd8e54d1951ebb70844ca471b505810118f857: Status 404 returned error can't find the container with id e87f0aa5601a46e58a5952033ffd8e54d1951ebb70844ca471b505810118f857 Jul 23 19:02:32.076356 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.076186 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 19:02:32.513503 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.513459 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" event={"ID":"b260f67b-78e1-4476-b69e-d5ccf6fb833d","Type":"ContainerStarted","Data":"c40ce3fea48a14dc1802fa97b63d4eb9a4aaa05aae26fc9ba5265a5a6e9310af"} Jul 23 19:02:32.515021 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.514990 2569 generic.go:356] "Generic (PLEG): container finished" podID="85e3be41-a0e6-49e7-8ac0-e59cad4785cc" containerID="fa1ac1ef7ba0350b1d358f94ae067f7e77fd8c29a3d1c97983b5764741ccf478" exitCode=0 Jul 23 19:02:32.515169 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.515069 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerDied","Data":"fa1ac1ef7ba0350b1d358f94ae067f7e77fd8c29a3d1c97983b5764741ccf478"} Jul 23 19:02:32.515169 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.515147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"e87f0aa5601a46e58a5952033ffd8e54d1951ebb70844ca471b505810118f857"} Jul 23 19:02:32.516575 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.516550 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" event={"ID":"42d5b034-52d9-4f6d-b760-07fcf9bae93f","Type":"ContainerStarted","Data":"dc6af60adf470e098f07cbdb707607c88279f25c4ea31fbd0da55ca8b250a817"} Jul 23 19:02:32.539261 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.539184 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" podStartSLOduration=1.902694425 podStartE2EDuration="4.539164819s" totalImagesPullingTime="2.636470394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:32.538903117 +0000 UTC m=+79.962901309" watchObservedRunningTime="2026-07-23 19:02:32.539164819 +0000 UTC m=+79.963163012" Jul 23 19:02:32.558917 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:32.558831 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" podStartSLOduration=1.256576047 podStartE2EDuration="3.558813281s" totalImagesPullingTime="2.302237234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:32.558266717 +0000 UTC m=+79.982264909" watchObservedRunningTime="2026-07-23 19:02:32.558813281 +0000 UTC m=+79.982811474" Jul 23 19:02:33.522496 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:33.522449 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:33.527442 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:33.527414 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7jzqt" Jul 23 19:02:36.513693 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.513664 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56597c4f44-xmxk4" Jul 23 19:02:36.541217 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.541183 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"84d4b6549b57b857ba084f0159d9ee71cc7f05c9b187e3b26c5d354834eb0dda"} Jul 23 19:02:36.541382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.541291 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"761be7dd2b06f86ee4d78b8478b41ec80584659dbd3af5ff539fd511323587b7"} Jul 23 19:02:36.541382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.541337 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"748e83231327757ba292ed1e2d2af95ccfd52be521174187618f0aa1a6a4766c"} Jul 23 19:02:36.541496 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.541383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"8f8372c1abb1227ce94e35a61e7aad90c62c57eab7e744651c9c1b848c59c88a"} Jul 23 19:02:36.541496 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.541412 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"e8d3294dbf5082d0330a5a3b577c374edfcfd23c0b89fe2ce8aacedbf3dc284b"} Jul 23 19:02:36.541496 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.541436 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85e3be41-a0e6-49e7-8ac0-e59cad4785cc","Type":"ContainerStarted","Data":"8b32a83ee0c32f52c92820e6a5b4613233183ca1df283616cffe3eb4a16c56e5"} Jul 23 19:02:36.585963 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:36.585902 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.187720749 podStartE2EDuration="6.585877347s" totalImagesPullingTime="3.378823235s" totalInitContainerRuntime="19.333363ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:02:36.582738647 +0000 UTC m=+84.006736850" watchObservedRunningTime="2026-07-23 19:02:36.585877347 +0000 UTC m=+84.009875541" Jul 23 19:02:40.769960 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:40.769929 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:40.770441 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:40.769986 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:40.774812 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:40.774788 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:41.278272 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:41.278198 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:02:41.566969 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:41.566903 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:02:41.635984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:41.635945 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6658f9bc6-jhhjw"] Jul 23 19:02:49.080498 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:49.080466 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:49.080961 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:49.080527 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:02:53.014318 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.014248 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c4f6b48cf-jfccc" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerName="console" containerID="cri-o://0251ef57753bb5d24295c3e49ff1f4d93a2edfe344c367a7714cb991446e8089" gracePeriod=15 Jul 23 19:02:53.612818 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.612782 2569 generic.go:356] "Generic (PLEG): container finished" podID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerID="0251ef57753bb5d24295c3e49ff1f4d93a2edfe344c367a7714cb991446e8089" exitCode=0 Jul 23 19:02:53.612977 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.612858 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4f6b48cf-jfccc" event={"ID":"69f8cca5-c287-428d-925a-1fb6b3b659c7","Type":"ContainerDied","Data":"0251ef57753bb5d24295c3e49ff1f4d93a2edfe344c367a7714cb991446e8089"} Jul 23 19:02:53.830429 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.830402 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:53.890746 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.890712 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-oauth-config\") pod \"69f8cca5-c287-428d-925a-1fb6b3b659c7\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " Jul 23 19:02:53.890892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.890755 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-oauth-serving-cert\") pod \"69f8cca5-c287-428d-925a-1fb6b3b659c7\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " Jul 23 19:02:53.890892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.890788 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-service-ca\") pod \"69f8cca5-c287-428d-925a-1fb6b3b659c7\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " Jul 23 19:02:53.890892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.890833 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9grtf\" (UniqueName: \"kubernetes.io/projected/69f8cca5-c287-428d-925a-1fb6b3b659c7-kube-api-access-9grtf\") pod \"69f8cca5-c287-428d-925a-1fb6b3b659c7\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " Jul 23 19:02:53.890892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.890875 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-serving-cert\") pod \"69f8cca5-c287-428d-925a-1fb6b3b659c7\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " Jul 23 19:02:53.891116 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.890930 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-config\") pod \"69f8cca5-c287-428d-925a-1fb6b3b659c7\" (UID: \"69f8cca5-c287-428d-925a-1fb6b3b659c7\") " Jul 23 19:02:53.891172 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.891148 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69f8cca5-c287-428d-925a-1fb6b3b659c7" (UID: "69f8cca5-c287-428d-925a-1fb6b3b659c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:02:53.891336 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.891217 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "69f8cca5-c287-428d-925a-1fb6b3b659c7" (UID: "69f8cca5-c287-428d-925a-1fb6b3b659c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:02:53.891460 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.891416 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-config" (OuterVolumeSpecName: "console-config") pod "69f8cca5-c287-428d-925a-1fb6b3b659c7" (UID: "69f8cca5-c287-428d-925a-1fb6b3b659c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:02:53.893142 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.893120 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69f8cca5-c287-428d-925a-1fb6b3b659c7" (UID: "69f8cca5-c287-428d-925a-1fb6b3b659c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:02:53.893245 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.893206 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69f8cca5-c287-428d-925a-1fb6b3b659c7-kube-api-access-9grtf" (OuterVolumeSpecName: "kube-api-access-9grtf") pod "69f8cca5-c287-428d-925a-1fb6b3b659c7" (UID: "69f8cca5-c287-428d-925a-1fb6b3b659c7"). InnerVolumeSpecName "kube-api-access-9grtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:02:53.893299 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.893217 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69f8cca5-c287-428d-925a-1fb6b3b659c7" (UID: "69f8cca5-c287-428d-925a-1fb6b3b659c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:02:53.991894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.991803 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-service-ca\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:02:53.991894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.991839 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9grtf\" (UniqueName: \"kubernetes.io/projected/69f8cca5-c287-428d-925a-1fb6b3b659c7-kube-api-access-9grtf\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:02:53.991894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.991854 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:02:53.991894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.991866 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:02:53.991894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.991879 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69f8cca5-c287-428d-925a-1fb6b3b659c7-console-oauth-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:02:53.991894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:53.991894 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69f8cca5-c287-428d-925a-1fb6b3b659c7-oauth-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:02:54.618158 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:54.618127 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4f6b48cf-jfccc" Jul 23 19:02:54.618158 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:54.618141 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4f6b48cf-jfccc" event={"ID":"69f8cca5-c287-428d-925a-1fb6b3b659c7","Type":"ContainerDied","Data":"ca9944fe8e4a73f23ca4f859e35bd3f6a3403f9773984f82070cc5c21e9d46d0"} Jul 23 19:02:54.618791 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:54.618206 2569 scope.go:117] "RemoveContainer" containerID="0251ef57753bb5d24295c3e49ff1f4d93a2edfe344c367a7714cb991446e8089" Jul 23 19:02:54.653527 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:54.653497 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4f6b48cf-jfccc"] Jul 23 19:02:54.660694 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:54.660673 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c4f6b48cf-jfccc"] Jul 23 19:02:55.078355 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:55.078323 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" path="/var/lib/kubelet/pods/69f8cca5-c287-428d-925a-1fb6b3b659c7/volumes" Jul 23 19:02:56.414834 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:02:56.414807 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-54n5t" Jul 23 19:03:06.660044 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:06.659974 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6658f9bc6-jhhjw" podUID="f82125a5-eb5e-451d-9cda-d687442a69b9" containerName="console" containerID="cri-o://6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5" gracePeriod=15 Jul 23 19:03:06.931591 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:06.931566 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:03:07.013742 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013712 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-trusted-ca-bundle\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.013931 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013760 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-oauth-config\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.013931 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013830 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-service-ca\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.013931 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013869 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-serving-cert\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.013931 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013894 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq86m\" (UniqueName: \"kubernetes.io/projected/f82125a5-eb5e-451d-9cda-d687442a69b9-kube-api-access-jq86m\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.014132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013945 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-oauth-serving-cert\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.014132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.013977 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-console-config\") pod \"f82125a5-eb5e-451d-9cda-d687442a69b9\" (UID: \"f82125a5-eb5e-451d-9cda-d687442a69b9\") " Jul 23 19:03:07.014878 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.014575 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-console-config" (OuterVolumeSpecName: "console-config") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:03:07.014878 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.014786 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:03:07.015353 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.015134 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:03:07.015595 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.015570 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-service-ca" (OuterVolumeSpecName: "service-ca") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:03:07.017435 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.017409 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:03:07.017514 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.017484 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82125a5-eb5e-451d-9cda-d687442a69b9-kube-api-access-jq86m" (OuterVolumeSpecName: "kube-api-access-jq86m") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "kube-api-access-jq86m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:03:07.017790 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.017772 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f82125a5-eb5e-451d-9cda-d687442a69b9" (UID: "f82125a5-eb5e-451d-9cda-d687442a69b9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:03:07.115439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115398 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-trusted-ca-bundle\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.115439 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115440 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-oauth-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.115679 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115457 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-service-ca\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.115679 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115471 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82125a5-eb5e-451d-9cda-d687442a69b9-console-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.115679 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115486 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq86m\" (UniqueName: \"kubernetes.io/projected/f82125a5-eb5e-451d-9cda-d687442a69b9-kube-api-access-jq86m\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.115679 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115501 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-oauth-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.115679 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.115514 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82125a5-eb5e-451d-9cda-d687442a69b9-console-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:03:07.679379 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.679340 2569 generic.go:356] "Generic (PLEG): container finished" podID="f82125a5-eb5e-451d-9cda-d687442a69b9" containerID="6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5" exitCode=0 Jul 23 19:03:07.679836 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.679388 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658f9bc6-jhhjw" Jul 23 19:03:07.679836 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.679430 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658f9bc6-jhhjw" event={"ID":"f82125a5-eb5e-451d-9cda-d687442a69b9","Type":"ContainerDied","Data":"6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5"} Jul 23 19:03:07.679836 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.679496 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658f9bc6-jhhjw" event={"ID":"f82125a5-eb5e-451d-9cda-d687442a69b9","Type":"ContainerDied","Data":"955391df86f85db30e6d3554d0e80744de250552b81b48ee7613774e6eba1960"} Jul 23 19:03:07.679836 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.679531 2569 scope.go:117] "RemoveContainer" containerID="6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5" Jul 23 19:03:07.687802 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.687786 2569 scope.go:117] "RemoveContainer" containerID="6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5" Jul 23 19:03:07.688062 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:03:07.688042 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5\": container with ID starting with 6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5 not found: ID does not exist" containerID="6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5" Jul 23 19:03:07.688108 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.688072 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5"} err="failed to get container status \"6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5\": rpc error: code = NotFound desc = could not find container \"6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5\": container with ID starting with 6fd1ada65addfed588cd89579ef6a55e58acb0af32d98e0df2b83a10ae8002e5 not found: ID does not exist" Jul 23 19:03:07.699413 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.699386 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6658f9bc6-jhhjw"] Jul 23 19:03:07.701936 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:07.701915 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6658f9bc6-jhhjw"] Jul 23 19:03:09.078382 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:09.078346 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82125a5-eb5e-451d-9cda-d687442a69b9" path="/var/lib/kubelet/pods/f82125a5-eb5e-451d-9cda-d687442a69b9/volumes" Jul 23 19:03:09.085415 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:09.085391 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:03:09.088997 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:09.088978 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8588757d9b-w9j6r" Jul 23 19:03:31.278031 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:31.277999 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:03:31.297922 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:31.297900 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:03:31.792176 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:31.792148 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 19:03:48.981361 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981326 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf"] Jul 23 19:03:48.981932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981778 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82125a5-eb5e-451d-9cda-d687442a69b9" containerName="console" Jul 23 19:03:48.981932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981791 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82125a5-eb5e-451d-9cda-d687442a69b9" containerName="console" Jul 23 19:03:48.981932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981814 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerName="console" Jul 23 19:03:48.981932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981823 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerName="console" Jul 23 19:03:48.981932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981879 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f8cca5-c287-428d-925a-1fb6b3b659c7" containerName="console" Jul 23 19:03:48.981932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.981889 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82125a5-eb5e-451d-9cda-d687442a69b9" containerName="console" Jul 23 19:03:48.984205 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.984179 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:48.991120 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.990952 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 19:03:48.991487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.991465 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 19:03:48.991922 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.991907 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 19:03:48.992030 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.992015 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 19:03:48.992151 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.992133 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-b7dqh\"" Jul 23 19:03:48.995757 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:48.995736 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 19:03:49.012021 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.011996 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf"] Jul 23 19:03:49.012119 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.012000 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 19:03:49.071934 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.071902 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-federate-client-tls\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.071934 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.071938 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.072132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.071959 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6h7t\" (UniqueName: \"kubernetes.io/projected/437b47ef-b869-4383-82b6-8a6297c1bc47-kube-api-access-p6h7t\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.072132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.071986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-metrics-client-ca\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.072132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.072063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-secret-telemeter-client\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.072132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.072102 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-serving-certs-ca-bundle\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.072281 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.072137 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.072281 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.072159 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-telemeter-client-tls\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173194 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173158 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-metrics-client-ca\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173394 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173206 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-secret-telemeter-client\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173394 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173336 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-serving-certs-ca-bundle\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173394 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173391 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173559 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-telemeter-client-tls\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173559 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173455 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-federate-client-tls\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173559 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.173559 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.173495 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6h7t\" (UniqueName: \"kubernetes.io/projected/437b47ef-b869-4383-82b6-8a6297c1bc47-kube-api-access-p6h7t\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.174036 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.174007 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-metrics-client-ca\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.174166 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.174059 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-serving-certs-ca-bundle\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.174456 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.174433 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/437b47ef-b869-4383-82b6-8a6297c1bc47-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.175858 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.175834 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-telemeter-client-tls\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.176138 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.176115 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.176181 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.176171 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-federate-client-tls\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.176282 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.176262 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/437b47ef-b869-4383-82b6-8a6297c1bc47-secret-telemeter-client\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.183207 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.183189 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6h7t\" (UniqueName: \"kubernetes.io/projected/437b47ef-b869-4383-82b6-8a6297c1bc47-kube-api-access-p6h7t\") pod \"telemeter-client-7dc8545fb9-4zvmf\" (UID: \"437b47ef-b869-4383-82b6-8a6297c1bc47\") " pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.293401 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.293315 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" Jul 23 19:03:49.428385 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.428356 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf"] Jul 23 19:03:49.429819 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:03:49.429792 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437b47ef_b869_4383_82b6_8a6297c1bc47.slice/crio-688a7313cc9d14032f22684a0c38990295aaaf4bfb8d90f03d8011f5b5c55b66 WatchSource:0}: Error finding container 688a7313cc9d14032f22684a0c38990295aaaf4bfb8d90f03d8011f5b5c55b66: Status 404 returned error can't find the container with id 688a7313cc9d14032f22684a0c38990295aaaf4bfb8d90f03d8011f5b5c55b66 Jul 23 19:03:49.848697 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:49.848660 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" event={"ID":"437b47ef-b869-4383-82b6-8a6297c1bc47","Type":"ContainerStarted","Data":"688a7313cc9d14032f22684a0c38990295aaaf4bfb8d90f03d8011f5b5c55b66"} Jul 23 19:03:51.860268 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:51.860170 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" event={"ID":"437b47ef-b869-4383-82b6-8a6297c1bc47","Type":"ContainerStarted","Data":"4804eaa92e6b5e7f9ddee0c0f0de283e98d7e838d351204339a0055af3ce80e1"} Jul 23 19:03:51.860268 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:51.860249 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" event={"ID":"437b47ef-b869-4383-82b6-8a6297c1bc47","Type":"ContainerStarted","Data":"94c0d43aaabdd99d3444eda33fd19689ccf8240c2209179bb3a64f92036cd5e8"} Jul 23 19:03:51.860639 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:51.860283 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" event={"ID":"437b47ef-b869-4383-82b6-8a6297c1bc47","Type":"ContainerStarted","Data":"b9a3de28f91cf8c94e5a4bc9f9ffdee2e873bc0db6b21c4413982efbdb6aeffc"} Jul 23 19:03:51.892649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:51.892599 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7dc8545fb9-4zvmf" podStartSLOduration=1.800191199 podStartE2EDuration="3.89258281s" totalImagesPullingTime="2.092391611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:03:51.889784216 +0000 UTC m=+159.313782417" watchObservedRunningTime="2026-07-23 19:03:51.89258281 +0000 UTC m=+159.316581002" Jul 23 19:03:52.579772 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.579741 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6dfb64f-c6mrj"] Jul 23 19:03:52.582068 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.582051 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.606160 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.606131 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6dfb64f-c6mrj"] Jul 23 19:03:52.705023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.704986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9lp8\" (UniqueName: \"kubernetes.io/projected/e82147f5-bb99-49f2-b3e0-be9733d96c09-kube-api-access-f9lp8\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.705023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.705037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-oauth-config\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.705311 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.705123 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-trusted-ca-bundle\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.705311 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.705185 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-oauth-serving-cert\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.705311 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.705234 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-serving-cert\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.705311 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.705288 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-service-ca\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.705463 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.705319 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-config\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806116 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806072 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-config\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806116 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806124 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lp8\" (UniqueName: \"kubernetes.io/projected/e82147f5-bb99-49f2-b3e0-be9733d96c09-kube-api-access-f9lp8\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806163 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-oauth-config\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806206 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-trusted-ca-bundle\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806287 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-oauth-serving-cert\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806328 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-serving-cert\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806400 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806359 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-service-ca\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.806933 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806897 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-oauth-serving-cert\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.807054 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806903 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-config\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.807054 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.806990 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-service-ca\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.807374 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.807350 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-trusted-ca-bundle\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.808905 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.808876 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-oauth-config\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.809086 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.809061 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-serving-cert\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.816779 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.816757 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9lp8\" (UniqueName: \"kubernetes.io/projected/e82147f5-bb99-49f2-b3e0-be9733d96c09-kube-api-access-f9lp8\") pod \"console-b6dfb64f-c6mrj\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:52.892283 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:52.892178 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:03:53.037053 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:53.037020 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6dfb64f-c6mrj"] Jul 23 19:03:53.042522 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:03:53.042494 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82147f5_bb99_49f2_b3e0_be9733d96c09.slice/crio-5a2929d06a6e9bdee7b6e000ed29ce1b845cf15562cc353563c839ea805fa3ba WatchSource:0}: Error finding container 5a2929d06a6e9bdee7b6e000ed29ce1b845cf15562cc353563c839ea805fa3ba: Status 404 returned error can't find the container with id 5a2929d06a6e9bdee7b6e000ed29ce1b845cf15562cc353563c839ea805fa3ba Jul 23 19:03:53.870577 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:53.870537 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6dfb64f-c6mrj" event={"ID":"e82147f5-bb99-49f2-b3e0-be9733d96c09","Type":"ContainerStarted","Data":"bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3"} Jul 23 19:03:53.870830 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:53.870618 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6dfb64f-c6mrj" event={"ID":"e82147f5-bb99-49f2-b3e0-be9733d96c09","Type":"ContainerStarted","Data":"5a2929d06a6e9bdee7b6e000ed29ce1b845cf15562cc353563c839ea805fa3ba"} Jul 23 19:03:53.899993 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:03:53.899936 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6dfb64f-c6mrj" podStartSLOduration=1.89992076 podStartE2EDuration="1.89992076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:03:53.898282815 +0000 UTC m=+161.322281005" watchObservedRunningTime="2026-07-23 19:03:53.89992076 +0000 UTC m=+161.323918950" Jul 23 19:04:00.043350 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.043314 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6dfb64f-c6mrj"] Jul 23 19:04:00.083094 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.083064 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f96d546c8-mjtxn"] Jul 23 19:04:00.085795 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.085778 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.109323 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.109286 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f96d546c8-mjtxn"] Jul 23 19:04:00.174588 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174555 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-oauth-serving-cert\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.174724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174598 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-oauth-config\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.174724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174631 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpbj6\" (UniqueName: \"kubernetes.io/projected/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-kube-api-access-zpbj6\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.174724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174687 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-serving-cert\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.174724 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174709 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-trusted-ca-bundle\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.174846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174744 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-config\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.174846 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.174779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-service-ca\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275501 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275464 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-config\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-service-ca\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275547 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-oauth-serving-cert\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-oauth-config\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpbj6\" (UniqueName: \"kubernetes.io/projected/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-kube-api-access-zpbj6\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275659 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-serving-cert\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.275912 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.275685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-trusted-ca-bundle\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.276316 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.276289 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-oauth-serving-cert\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.276428 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.276316 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-service-ca\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.276428 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.276293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-config\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.276533 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.276481 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-trusted-ca-bundle\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.277908 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.277885 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-oauth-config\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.278421 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.278397 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-serving-cert\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.286360 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.286338 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpbj6\" (UniqueName: \"kubernetes.io/projected/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-kube-api-access-zpbj6\") pod \"console-6f96d546c8-mjtxn\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.395243 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.395146 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:00.529899 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.529875 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f96d546c8-mjtxn"] Jul 23 19:04:00.532576 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:04:00.532553 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69a35ad_f1d5_4c22_a7ad_ab205df6bac3.slice/crio-3a8e3c7ef50a246c5b0d61df4ba85e827b22d83db7baf7a6163d5879cce19198 WatchSource:0}: Error finding container 3a8e3c7ef50a246c5b0d61df4ba85e827b22d83db7baf7a6163d5879cce19198: Status 404 returned error can't find the container with id 3a8e3c7ef50a246c5b0d61df4ba85e827b22d83db7baf7a6163d5879cce19198 Jul 23 19:04:00.901897 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.901858 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96d546c8-mjtxn" event={"ID":"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3","Type":"ContainerStarted","Data":"a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96"} Jul 23 19:04:00.902097 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.901920 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96d546c8-mjtxn" event={"ID":"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3","Type":"ContainerStarted","Data":"3a8e3c7ef50a246c5b0d61df4ba85e827b22d83db7baf7a6163d5879cce19198"} Jul 23 19:04:00.927984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:00.927934 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f96d546c8-mjtxn" podStartSLOduration=0.927918676 podStartE2EDuration="927.918676ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:04:00.927442795 +0000 UTC m=+168.351440985" watchObservedRunningTime="2026-07-23 19:04:00.927918676 +0000 UTC m=+168.351916866" Jul 23 19:04:02.893116 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:02.893080 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:04:10.396300 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:10.396186 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:10.396300 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:10.396284 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:10.400828 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:10.400801 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:10.947099 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:10.947073 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:04:11.011047 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:11.011017 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5f97477b-2zbdt"] Jul 23 19:04:25.062648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.062602 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b6dfb64f-c6mrj" podUID="e82147f5-bb99-49f2-b3e0-be9733d96c09" containerName="console" containerID="cri-o://bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3" gracePeriod=15 Jul 23 19:04:25.306891 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.306867 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:04:25.404923 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.404835 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-serving-cert\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.404923 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.404888 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-service-ca\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.404923 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.404904 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-config\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.405188 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.404949 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9lp8\" (UniqueName: \"kubernetes.io/projected/e82147f5-bb99-49f2-b3e0-be9733d96c09-kube-api-access-f9lp8\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.405188 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405032 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-oauth-config\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.405188 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405089 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-trusted-ca-bundle\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.405188 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405141 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-oauth-serving-cert\") pod \"e82147f5-bb99-49f2-b3e0-be9733d96c09\" (UID: \"e82147f5-bb99-49f2-b3e0-be9733d96c09\") " Jul 23 19:04:25.405408 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405323 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-service-ca" (OuterVolumeSpecName: "service-ca") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:25.405476 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405451 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-config" (OuterVolumeSpecName: "console-config") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:25.405476 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405467 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-service-ca\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:25.405672 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405645 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:25.405738 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.405697 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:25.407259 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.407212 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:04:25.407546 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.407528 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82147f5-bb99-49f2-b3e0-be9733d96c09-kube-api-access-f9lp8" (OuterVolumeSpecName: "kube-api-access-f9lp8") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "kube-api-access-f9lp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:04:25.407546 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.407527 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e82147f5-bb99-49f2-b3e0-be9733d96c09" (UID: "e82147f5-bb99-49f2-b3e0-be9733d96c09"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:04:25.506305 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.506273 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:25.506305 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.506302 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9lp8\" (UniqueName: \"kubernetes.io/projected/e82147f5-bb99-49f2-b3e0-be9733d96c09-kube-api-access-f9lp8\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:25.506305 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.506312 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-oauth-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:25.506525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.506323 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-trusted-ca-bundle\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:25.506525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.506332 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e82147f5-bb99-49f2-b3e0-be9733d96c09-oauth-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:25.506525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:25.506341 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e82147f5-bb99-49f2-b3e0-be9733d96c09-console-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:26.010544 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.010512 2569 generic.go:356] "Generic (PLEG): container finished" podID="e82147f5-bb99-49f2-b3e0-be9733d96c09" containerID="bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3" exitCode=0 Jul 23 19:04:26.010701 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.010562 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6dfb64f-c6mrj" Jul 23 19:04:26.010701 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.010601 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6dfb64f-c6mrj" event={"ID":"e82147f5-bb99-49f2-b3e0-be9733d96c09","Type":"ContainerDied","Data":"bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3"} Jul 23 19:04:26.010701 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.010655 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6dfb64f-c6mrj" event={"ID":"e82147f5-bb99-49f2-b3e0-be9733d96c09","Type":"ContainerDied","Data":"5a2929d06a6e9bdee7b6e000ed29ce1b845cf15562cc353563c839ea805fa3ba"} Jul 23 19:04:26.010701 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.010682 2569 scope.go:117] "RemoveContainer" containerID="bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3" Jul 23 19:04:26.019519 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.019391 2569 scope.go:117] "RemoveContainer" containerID="bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3" Jul 23 19:04:26.019688 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:04:26.019668 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3\": container with ID starting with bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3 not found: ID does not exist" containerID="bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3" Jul 23 19:04:26.019749 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.019700 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3"} err="failed to get container status \"bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3\": rpc error: code = NotFound desc = could not find container \"bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3\": container with ID starting with bd91bb6a6450ecb85c0f8f21da13da8d5f700291a244f4376515569989c911c3 not found: ID does not exist" Jul 23 19:04:26.035213 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.035188 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6dfb64f-c6mrj"] Jul 23 19:04:26.041690 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:26.041660 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6dfb64f-c6mrj"] Jul 23 19:04:27.078903 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:27.078871 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e82147f5-bb99-49f2-b3e0-be9733d96c09" path="/var/lib/kubelet/pods/e82147f5-bb99-49f2-b3e0-be9733d96c09/volumes" Jul 23 19:04:36.031414 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.031354 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f5f97477b-2zbdt" podUID="d5795f1e-9201-4c39-9cee-fab19357fb87" containerName="console" containerID="cri-o://1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d" gracePeriod=15 Jul 23 19:04:36.269897 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.269874 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:04:36.305078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305011 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-serving-cert\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305070 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-console-config\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305317 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305105 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-trusted-ca-bundle\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305317 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305126 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-oauth-config\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305317 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305142 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-oauth-serving-cert\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305317 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305166 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-service-ca\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305317 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305197 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp8bm\" (UniqueName: \"kubernetes.io/projected/d5795f1e-9201-4c39-9cee-fab19357fb87-kube-api-access-lp8bm\") pod \"d5795f1e-9201-4c39-9cee-fab19357fb87\" (UID: \"d5795f1e-9201-4c39-9cee-fab19357fb87\") " Jul 23 19:04:36.305576 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305554 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-console-config" (OuterVolumeSpecName: "console-config") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:36.305631 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305551 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:36.305696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.305649 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:36.306126 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.306100 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:04:36.307267 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.307217 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:04:36.307371 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.307286 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5795f1e-9201-4c39-9cee-fab19357fb87-kube-api-access-lp8bm" (OuterVolumeSpecName: "kube-api-access-lp8bm") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "kube-api-access-lp8bm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:04:36.307438 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.307381 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5795f1e-9201-4c39-9cee-fab19357fb87" (UID: "d5795f1e-9201-4c39-9cee-fab19357fb87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:04:36.406612 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406568 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-console-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:36.406612 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406602 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-trusted-ca-bundle\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:36.406612 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406611 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-oauth-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:36.406612 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406621 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-oauth-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:36.406898 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406631 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5795f1e-9201-4c39-9cee-fab19357fb87-service-ca\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:36.406898 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406640 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp8bm\" (UniqueName: \"kubernetes.io/projected/d5795f1e-9201-4c39-9cee-fab19357fb87-kube-api-access-lp8bm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:36.406898 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:36.406650 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5795f1e-9201-4c39-9cee-fab19357fb87-console-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:04:37.056393 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.056353 2569 generic.go:356] "Generic (PLEG): container finished" podID="d5795f1e-9201-4c39-9cee-fab19357fb87" containerID="1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d" exitCode=0 Jul 23 19:04:37.056855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.056398 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f97477b-2zbdt" Jul 23 19:04:37.056855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.056442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f97477b-2zbdt" event={"ID":"d5795f1e-9201-4c39-9cee-fab19357fb87","Type":"ContainerDied","Data":"1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d"} Jul 23 19:04:37.056855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.056492 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f97477b-2zbdt" event={"ID":"d5795f1e-9201-4c39-9cee-fab19357fb87","Type":"ContainerDied","Data":"366438b9b1b1bc5c63a2e10eab8ce46b0e479ba61ed3c4d403433ac048093954"} Jul 23 19:04:37.056855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.056513 2569 scope.go:117] "RemoveContainer" containerID="1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d" Jul 23 19:04:37.064803 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.064787 2569 scope.go:117] "RemoveContainer" containerID="1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d" Jul 23 19:04:37.065069 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:04:37.065051 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d\": container with ID starting with 1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d not found: ID does not exist" containerID="1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d" Jul 23 19:04:37.065115 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.065077 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d"} err="failed to get container status \"1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d\": rpc error: code = NotFound desc = could not find container \"1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d\": container with ID starting with 1a2cd757c817ea68dbed267ab8a82439f22be4ddd4122d0b1081cbc259706b2d not found: ID does not exist" Jul 23 19:04:37.088878 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.088854 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5f97477b-2zbdt"] Jul 23 19:04:37.094384 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:37.094364 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5f97477b-2zbdt"] Jul 23 19:04:39.078081 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:04:39.078050 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5795f1e-9201-4c39-9cee-fab19357fb87" path="/var/lib/kubelet/pods/d5795f1e-9201-4c39-9cee-fab19357fb87/volumes" Jul 23 19:06:12.955088 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:12.955059 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 19:06:59.250835 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.250798 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg"] Jul 23 19:06:59.251264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.251134 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5795f1e-9201-4c39-9cee-fab19357fb87" containerName="console" Jul 23 19:06:59.251264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.251145 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5795f1e-9201-4c39-9cee-fab19357fb87" containerName="console" Jul 23 19:06:59.251264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.251160 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82147f5-bb99-49f2-b3e0-be9733d96c09" containerName="console" Jul 23 19:06:59.251264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.251165 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82147f5-bb99-49f2-b3e0-be9733d96c09" containerName="console" Jul 23 19:06:59.251264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.251219 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e82147f5-bb99-49f2-b3e0-be9733d96c09" containerName="console" Jul 23 19:06:59.251264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.251246 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5795f1e-9201-4c39-9cee-fab19357fb87" containerName="console" Jul 23 19:06:59.253920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.253903 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.260798 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.260779 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 19:06:59.261541 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.261526 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xr57h\"" Jul 23 19:06:59.261598 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.261556 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 19:06:59.270217 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.270198 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg"] Jul 23 19:06:59.364952 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.364911 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ab72ae-2a7e-419d-8870-767d1f8a8cb9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-56fqg\" (UID: \"11ab72ae-2a7e-419d-8870-767d1f8a8cb9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.364952 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.364952 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-729q9\" (UniqueName: \"kubernetes.io/projected/11ab72ae-2a7e-419d-8870-767d1f8a8cb9-kube-api-access-729q9\") pod \"openshift-lws-operator-fd8ccff4c-56fqg\" (UID: \"11ab72ae-2a7e-419d-8870-767d1f8a8cb9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.466458 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.466420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ab72ae-2a7e-419d-8870-767d1f8a8cb9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-56fqg\" (UID: \"11ab72ae-2a7e-419d-8870-767d1f8a8cb9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.466458 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.466460 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-729q9\" (UniqueName: \"kubernetes.io/projected/11ab72ae-2a7e-419d-8870-767d1f8a8cb9-kube-api-access-729q9\") pod \"openshift-lws-operator-fd8ccff4c-56fqg\" (UID: \"11ab72ae-2a7e-419d-8870-767d1f8a8cb9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.466871 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.466831 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ab72ae-2a7e-419d-8870-767d1f8a8cb9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-56fqg\" (UID: \"11ab72ae-2a7e-419d-8870-767d1f8a8cb9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.484676 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.484641 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-729q9\" (UniqueName: \"kubernetes.io/projected/11ab72ae-2a7e-419d-8870-767d1f8a8cb9-kube-api-access-729q9\") pod \"openshift-lws-operator-fd8ccff4c-56fqg\" (UID: \"11ab72ae-2a7e-419d-8870-767d1f8a8cb9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.576358 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.576264 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" Jul 23 19:06:59.720824 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.720783 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg"] Jul 23 19:06:59.723192 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:06:59.723160 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11ab72ae_2a7e_419d_8870_767d1f8a8cb9.slice/crio-d329c94fff2809168f428fa6fe13ef1ccd4865f278b9d53ae8f71b42d673353a WatchSource:0}: Error finding container d329c94fff2809168f428fa6fe13ef1ccd4865f278b9d53ae8f71b42d673353a: Status 404 returned error can't find the container with id d329c94fff2809168f428fa6fe13ef1ccd4865f278b9d53ae8f71b42d673353a Jul 23 19:06:59.724589 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.724569 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 19:06:59.962360 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.962321 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp"] Jul 23 19:06:59.966515 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.966494 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:06:59.969214 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.969191 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 19:06:59.969341 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.969219 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hd57j\"" Jul 23 19:06:59.969341 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.969267 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 19:06:59.980997 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:06:59.980973 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp"] Jul 23 19:07:00.071189 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.071157 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvj4\" (UniqueName: \"kubernetes.io/projected/adb66a12-6c0a-4f61-8d42-d69f2140fe3c-kube-api-access-tfvj4\") pod \"cert-manager-cainjector-559cdd8c87-5hzjp\" (UID: \"adb66a12-6c0a-4f61-8d42-d69f2140fe3c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.071378 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.071215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adb66a12-6c0a-4f61-8d42-d69f2140fe3c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5hzjp\" (UID: \"adb66a12-6c0a-4f61-8d42-d69f2140fe3c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.172112 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.172072 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvj4\" (UniqueName: \"kubernetes.io/projected/adb66a12-6c0a-4f61-8d42-d69f2140fe3c-kube-api-access-tfvj4\") pod \"cert-manager-cainjector-559cdd8c87-5hzjp\" (UID: \"adb66a12-6c0a-4f61-8d42-d69f2140fe3c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.172304 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.172134 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adb66a12-6c0a-4f61-8d42-d69f2140fe3c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5hzjp\" (UID: \"adb66a12-6c0a-4f61-8d42-d69f2140fe3c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.185613 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.185587 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvj4\" (UniqueName: \"kubernetes.io/projected/adb66a12-6c0a-4f61-8d42-d69f2140fe3c-kube-api-access-tfvj4\") pod \"cert-manager-cainjector-559cdd8c87-5hzjp\" (UID: \"adb66a12-6c0a-4f61-8d42-d69f2140fe3c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.196458 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.196434 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adb66a12-6c0a-4f61-8d42-d69f2140fe3c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5hzjp\" (UID: \"adb66a12-6c0a-4f61-8d42-d69f2140fe3c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.276073 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.275984 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" Jul 23 19:07:00.405923 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.405882 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp"] Jul 23 19:07:00.407949 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:07:00.407917 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadb66a12_6c0a_4f61_8d42_d69f2140fe3c.slice/crio-a6cfe418fc9930c049122e7a14d906b841eaf37c267295c9add03b2e2ef8a02d WatchSource:0}: Error finding container a6cfe418fc9930c049122e7a14d906b841eaf37c267295c9add03b2e2ef8a02d: Status 404 returned error can't find the container with id a6cfe418fc9930c049122e7a14d906b841eaf37c267295c9add03b2e2ef8a02d Jul 23 19:07:00.632411 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.632300 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" event={"ID":"11ab72ae-2a7e-419d-8870-767d1f8a8cb9","Type":"ContainerStarted","Data":"d329c94fff2809168f428fa6fe13ef1ccd4865f278b9d53ae8f71b42d673353a"} Jul 23 19:07:00.633880 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:00.633846 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" event={"ID":"adb66a12-6c0a-4f61-8d42-d69f2140fe3c","Type":"ContainerStarted","Data":"a6cfe418fc9930c049122e7a14d906b841eaf37c267295c9add03b2e2ef8a02d"} Jul 23 19:07:04.657509 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:04.657388 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" event={"ID":"11ab72ae-2a7e-419d-8870-767d1f8a8cb9","Type":"ContainerStarted","Data":"80287030731f85639d6dbdbf503d615ce8d211b27a0fd48727d8c62786d01e16"} Jul 23 19:07:04.659145 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:04.659112 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" event={"ID":"adb66a12-6c0a-4f61-8d42-d69f2140fe3c","Type":"ContainerStarted","Data":"2a271445180bdb75475c2df0f8a43bd53b9e9573a5a4ed8a7426c7bb3ac5adb0"} Jul 23 19:07:04.679141 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:04.679090 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-56fqg" podStartSLOduration=1.096071262 podStartE2EDuration="5.679072514s" totalImagesPullingTime="4.583001252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:07:04.678614641 +0000 UTC m=+352.102612846" watchObservedRunningTime="2026-07-23 19:07:04.679072514 +0000 UTC m=+352.103070710" Jul 23 19:07:04.708390 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:04.708336 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hzjp" podStartSLOduration=1.808103529 podStartE2EDuration="5.708320668s" totalImagesPullingTime="3.900217139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:07:04.706480979 +0000 UTC m=+352.130479175" watchObservedRunningTime="2026-07-23 19:07:04.708320668 +0000 UTC m=+352.132318860" Jul 23 19:07:23.625608 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.625570 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2"] Jul 23 19:07:23.631143 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.631118 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.635201 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.635177 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wh78r\"" Jul 23 19:07:23.635616 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.635593 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 19:07:23.635862 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.635846 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 19:07:23.636594 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.636575 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 19:07:23.636925 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.636904 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 19:07:23.796525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.796487 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b6f5504-f23c-4d87-8689-ec4a0fd00899-tmp\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.796773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.796530 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b6f5504-f23c-4d87-8689-ec4a0fd00899-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.796773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.796559 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b6f5504-f23c-4d87-8689-ec4a0fd00899-manifests\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.796773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.796644 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b6f5504-f23c-4d87-8689-ec4a0fd00899-webhook-cert\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.796773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.796688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp246\" (UniqueName: \"kubernetes.io/projected/4b6f5504-f23c-4d87-8689-ec4a0fd00899-kube-api-access-pp246\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.804608 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.804578 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2"] Jul 23 19:07:23.897590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.897506 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b6f5504-f23c-4d87-8689-ec4a0fd00899-webhook-cert\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.897590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.897546 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp246\" (UniqueName: \"kubernetes.io/projected/4b6f5504-f23c-4d87-8689-ec4a0fd00899-kube-api-access-pp246\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.897826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.897614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b6f5504-f23c-4d87-8689-ec4a0fd00899-tmp\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.897826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.897640 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b6f5504-f23c-4d87-8689-ec4a0fd00899-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.897826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.897670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b6f5504-f23c-4d87-8689-ec4a0fd00899-manifests\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.898128 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.898103 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b6f5504-f23c-4d87-8689-ec4a0fd00899-manifests\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.899826 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.899799 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b6f5504-f23c-4d87-8689-ec4a0fd00899-tmp\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.900066 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.900046 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b6f5504-f23c-4d87-8689-ec4a0fd00899-webhook-cert\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.900285 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.900263 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b6f5504-f23c-4d87-8689-ec4a0fd00899-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.907654 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.907630 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp246\" (UniqueName: \"kubernetes.io/projected/4b6f5504-f23c-4d87-8689-ec4a0fd00899-kube-api-access-pp246\") pod \"opendatahub-operator-controller-manager-6657c8cb8d-4z6n2\" (UID: \"4b6f5504-f23c-4d87-8689-ec4a0fd00899\") " pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:23.941520 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:23.941483 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:24.102863 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:24.102836 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2"] Jul 23 19:07:24.105837 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:07:24.105810 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6f5504_f23c_4d87_8689_ec4a0fd00899.slice/crio-b4dd3aa6901637c3a2d0c08c9124767645a1001727156af024b7a6ab8f2e6351 WatchSource:0}: Error finding container b4dd3aa6901637c3a2d0c08c9124767645a1001727156af024b7a6ab8f2e6351: Status 404 returned error can't find the container with id b4dd3aa6901637c3a2d0c08c9124767645a1001727156af024b7a6ab8f2e6351 Jul 23 19:07:24.746959 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:24.746916 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" event={"ID":"4b6f5504-f23c-4d87-8689-ec4a0fd00899","Type":"ContainerStarted","Data":"b4dd3aa6901637c3a2d0c08c9124767645a1001727156af024b7a6ab8f2e6351"} Jul 23 19:07:28.770962 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:28.770922 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" event={"ID":"4b6f5504-f23c-4d87-8689-ec4a0fd00899","Type":"ContainerStarted","Data":"0acdb882787061cb93306f275a2e273181eac599586a234aafe66a49aad0e84f"} Jul 23 19:07:29.776819 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:29.776789 2569 generic.go:356] "Generic (PLEG): container finished" podID="4b6f5504-f23c-4d87-8689-ec4a0fd00899" containerID="0acdb882787061cb93306f275a2e273181eac599586a234aafe66a49aad0e84f" exitCode=0 Jul 23 19:07:29.777200 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:29.776880 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" event={"ID":"4b6f5504-f23c-4d87-8689-ec4a0fd00899","Type":"ContainerDied","Data":"0acdb882787061cb93306f275a2e273181eac599586a234aafe66a49aad0e84f"} Jul 23 19:07:30.782920 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:30.782882 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" event={"ID":"4b6f5504-f23c-4d87-8689-ec4a0fd00899","Type":"ContainerStarted","Data":"3fb6aa83900d92928d835931f2bb9418a35bbbe60961ddec8be992f0eea6d8b7"} Jul 23 19:07:30.783333 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:30.782991 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:41.789599 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:41.789568 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" Jul 23 19:07:41.827615 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:41.827553 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6657c8cb8d-4z6n2" podStartSLOduration=13.98839021 podStartE2EDuration="18.827533824s" totalImagesPullingTime="3.855764223s" totalInitContainerRuntime="983.379391ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:07:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:07:30.822885969 +0000 UTC m=+378.246884161" watchObservedRunningTime="2026-07-23 19:07:41.827533824 +0000 UTC m=+389.251532017" Jul 23 19:07:42.877100 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.877064 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-779d54d68-cw87c"] Jul 23 19:07:42.880522 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.880506 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:42.885607 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.885579 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xgzb6\"" Jul 23 19:07:42.885761 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.885649 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 19:07:42.885761 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.885579 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 19:07:42.885761 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.885648 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 19:07:42.900085 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.900054 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-779d54d68-cw87c"] Jul 23 19:07:42.976512 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.976468 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bc46626-3d19-4558-9415-5936e0b8292f-cert\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:42.976710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.976556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bc46626-3d19-4558-9415-5936e0b8292f-metrics-cert\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:42.976710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.976593 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3bc46626-3d19-4558-9415-5936e0b8292f-manager-config\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:42.976710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:42.976621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rq7s\" (UniqueName: \"kubernetes.io/projected/3bc46626-3d19-4558-9415-5936e0b8292f-kube-api-access-6rq7s\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.077360 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.077328 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3bc46626-3d19-4558-9415-5936e0b8292f-manager-config\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.077554 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.077379 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rq7s\" (UniqueName: \"kubernetes.io/projected/3bc46626-3d19-4558-9415-5936e0b8292f-kube-api-access-6rq7s\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.077554 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.077418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bc46626-3d19-4558-9415-5936e0b8292f-cert\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.077554 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.077496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bc46626-3d19-4558-9415-5936e0b8292f-metrics-cert\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.078214 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.078187 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3bc46626-3d19-4558-9415-5936e0b8292f-manager-config\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.079968 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.079942 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bc46626-3d19-4558-9415-5936e0b8292f-metrics-cert\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.079968 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.079962 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bc46626-3d19-4558-9415-5936e0b8292f-cert\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.103295 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.103270 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rq7s\" (UniqueName: \"kubernetes.io/projected/3bc46626-3d19-4558-9415-5936e0b8292f-kube-api-access-6rq7s\") pod \"lws-controller-manager-779d54d68-cw87c\" (UID: \"3bc46626-3d19-4558-9415-5936e0b8292f\") " pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.189543 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.189514 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:43.341261 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.341218 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-779d54d68-cw87c"] Jul 23 19:07:43.341525 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:07:43.341499 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc46626_3d19_4558_9415_5936e0b8292f.slice/crio-2a3ecf25963b04220a0d0afdcb67faff64cac1a2ccd488a81aba88eb8d977d2a WatchSource:0}: Error finding container 2a3ecf25963b04220a0d0afdcb67faff64cac1a2ccd488a81aba88eb8d977d2a: Status 404 returned error can't find the container with id 2a3ecf25963b04220a0d0afdcb67faff64cac1a2ccd488a81aba88eb8d977d2a Jul 23 19:07:43.840921 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:43.840889 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" event={"ID":"3bc46626-3d19-4558-9415-5936e0b8292f","Type":"ContainerStarted","Data":"2a3ecf25963b04220a0d0afdcb67faff64cac1a2ccd488a81aba88eb8d977d2a"} Jul 23 19:07:44.762306 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.762270 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74b646958c-wtgh7"] Jul 23 19:07:44.765638 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.765617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.776413 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.776389 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2kqgr\"" Jul 23 19:07:44.777857 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.777829 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 19:07:44.778135 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.778117 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 19:07:44.778413 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.778391 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 19:07:44.778688 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.778675 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 19:07:44.796290 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.796256 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74b646958c-wtgh7"] Jul 23 19:07:44.896298 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.896266 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tmp\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.896470 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.896309 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tls-certs\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.896470 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.896363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5mf\" (UniqueName: \"kubernetes.io/projected/7fb94798-9ee9-40f9-807e-54bdfb309a2b-kube-api-access-9c5mf\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.997547 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.997511 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tmp\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.997689 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.997555 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tls-certs\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.997753 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.997678 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5mf\" (UniqueName: \"kubernetes.io/projected/7fb94798-9ee9-40f9-807e-54bdfb309a2b-kube-api-access-9c5mf\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:44.997803 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:07:44.997788 2569 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 23 19:07:44.997856 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:07:44.997842 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tls-certs podName:7fb94798-9ee9-40f9-807e-54bdfb309a2b nodeName:}" failed. No retries permitted until 2026-07-23 19:07:45.497826821 +0000 UTC m=+392.921824991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tls-certs") pod "kube-auth-proxy-74b646958c-wtgh7" (UID: "7fb94798-9ee9-40f9-807e-54bdfb309a2b") : secret "kube-auth-proxy-tls" not found Jul 23 19:07:44.999739 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:44.999723 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tmp\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:45.008877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.008847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5mf\" (UniqueName: \"kubernetes.io/projected/7fb94798-9ee9-40f9-807e-54bdfb309a2b-kube-api-access-9c5mf\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:45.502497 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.502458 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tls-certs\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:45.504915 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.504893 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb94798-9ee9-40f9-807e-54bdfb309a2b-tls-certs\") pod \"kube-auth-proxy-74b646958c-wtgh7\" (UID: \"7fb94798-9ee9-40f9-807e-54bdfb309a2b\") " pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:45.676387 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.676346 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" Jul 23 19:07:45.814586 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.814560 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74b646958c-wtgh7"] Jul 23 19:07:45.816544 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:07:45.816504 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb94798_9ee9_40f9_807e_54bdfb309a2b.slice/crio-8b4c34a1b06e02dd874fd2eab065402f9868e208ce176b756239238a7a5c153a WatchSource:0}: Error finding container 8b4c34a1b06e02dd874fd2eab065402f9868e208ce176b756239238a7a5c153a: Status 404 returned error can't find the container with id 8b4c34a1b06e02dd874fd2eab065402f9868e208ce176b756239238a7a5c153a Jul 23 19:07:45.851414 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.851376 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" event={"ID":"7fb94798-9ee9-40f9-807e-54bdfb309a2b","Type":"ContainerStarted","Data":"8b4c34a1b06e02dd874fd2eab065402f9868e208ce176b756239238a7a5c153a"} Jul 23 19:07:45.852737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.852714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" event={"ID":"3bc46626-3d19-4558-9415-5936e0b8292f","Type":"ContainerStarted","Data":"6ff20a7c7327f24b416ebf943ec15ffe8e69c699b02c624050c21fadb98423e8"} Jul 23 19:07:45.852858 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.852845 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:07:45.874761 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:45.874711 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" podStartSLOduration=2.412276049 podStartE2EDuration="3.87469596s" totalImagesPullingTime="1.462419911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:07:45.87345043 +0000 UTC m=+393.297448619" watchObservedRunningTime="2026-07-23 19:07:45.87469596 +0000 UTC m=+393.298694151" Jul 23 19:07:48.871092 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:48.871003 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" event={"ID":"7fb94798-9ee9-40f9-807e-54bdfb309a2b","Type":"ContainerStarted","Data":"0cfa77aac9b4cca3d9cef36f0276d0dc84c465d1af5d46ce3c93d5b4c9a956a7"} Jul 23 19:07:48.892119 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:48.892068 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74b646958c-wtgh7" podStartSLOduration=2.118160269 podStartE2EDuration="4.892050301s" totalImagesPullingTime="2.773890032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:07:48.889996517 +0000 UTC m=+396.313994710" watchObservedRunningTime="2026-07-23 19:07:48.892050301 +0000 UTC m=+396.316048493" Jul 23 19:07:56.861860 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:07:56.861830 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-779d54d68-cw87c" Jul 23 19:08:56.929014 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.928977 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5748bcc894-9lnn4"] Jul 23 19:08:56.932708 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.932684 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.947099 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.947069 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5748bcc894-9lnn4"] Jul 23 19:08:56.969685 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969653 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-oauth-serving-cert\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.969685 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969690 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg4bt\" (UniqueName: \"kubernetes.io/projected/2031b2f7-3245-4181-9a8d-ee6db3d19fea-kube-api-access-qg4bt\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.969889 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969754 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-config\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.969889 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-serving-cert\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.969889 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-service-ca\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.969889 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-trusted-ca-bundle\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:56.970011 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:56.969896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-oauth-config\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.070877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.070839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-oauth-serving-cert\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.070877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.070878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg4bt\" (UniqueName: \"kubernetes.io/projected/2031b2f7-3245-4181-9a8d-ee6db3d19fea-kube-api-access-qg4bt\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071100 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.070929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-config\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071100 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.070947 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-serving-cert\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071100 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.070994 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-service-ca\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071100 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.071033 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-trusted-ca-bundle\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071100 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.071059 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-oauth-config\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.071688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-config\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.071696 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-service-ca\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071831 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.071720 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-oauth-serving-cert\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.071979 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.071954 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2031b2f7-3245-4181-9a8d-ee6db3d19fea-trusted-ca-bundle\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.073542 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.073515 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-oauth-config\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.073675 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.073651 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2031b2f7-3245-4181-9a8d-ee6db3d19fea-console-serving-cert\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.084545 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.084525 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg4bt\" (UniqueName: \"kubernetes.io/projected/2031b2f7-3245-4181-9a8d-ee6db3d19fea-kube-api-access-qg4bt\") pod \"console-5748bcc894-9lnn4\" (UID: \"2031b2f7-3245-4181-9a8d-ee6db3d19fea\") " pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.242851 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.242814 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:08:57.378653 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:57.378548 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5748bcc894-9lnn4"] Jul 23 19:08:57.382833 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:08:57.382078 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2031b2f7_3245_4181_9a8d_ee6db3d19fea.slice/crio-d539c561718cfba0b0ce975e9e6ee469f916d32a9e2bd88248730cb31a165f99 WatchSource:0}: Error finding container d539c561718cfba0b0ce975e9e6ee469f916d32a9e2bd88248730cb31a165f99: Status 404 returned error can't find the container with id d539c561718cfba0b0ce975e9e6ee469f916d32a9e2bd88248730cb31a165f99 Jul 23 19:08:58.185478 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:58.185436 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5748bcc894-9lnn4" event={"ID":"2031b2f7-3245-4181-9a8d-ee6db3d19fea","Type":"ContainerStarted","Data":"bbb4e1dae2dea529bf9528271da9aa78a939e370785519877a3c7ec447a83df5"} Jul 23 19:08:58.185844 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:58.185497 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5748bcc894-9lnn4" event={"ID":"2031b2f7-3245-4181-9a8d-ee6db3d19fea","Type":"ContainerStarted","Data":"d539c561718cfba0b0ce975e9e6ee469f916d32a9e2bd88248730cb31a165f99"} Jul 23 19:08:58.209676 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:08:58.209627 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5748bcc894-9lnn4" podStartSLOduration=2.209612579 podStartE2EDuration="2.209612579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:08:58.207592572 +0000 UTC m=+465.631590782" watchObservedRunningTime="2026-07-23 19:08:58.209612579 +0000 UTC m=+465.633610770" Jul 23 19:09:07.243888 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:07.243851 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:09:07.244359 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:07.243928 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:09:07.248771 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:07.248747 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:09:08.237153 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:08.237129 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5748bcc894-9lnn4" Jul 23 19:09:08.301257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:08.301206 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f96d546c8-mjtxn"] Jul 23 19:09:33.322457 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.322417 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f96d546c8-mjtxn" podUID="a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" containerName="console" containerID="cri-o://a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96" gracePeriod=15 Jul 23 19:09:33.565658 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.565635 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:09:33.618052 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.617966 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-oauth-serving-cert\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618052 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618021 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-service-ca\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618052 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618048 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-serving-cert\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618319 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618103 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-config\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618319 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618186 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-oauth-config\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618319 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618299 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpbj6\" (UniqueName: \"kubernetes.io/projected/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-kube-api-access-zpbj6\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618510 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618337 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-trusted-ca-bundle\") pod \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\" (UID: \"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3\") " Jul 23 19:09:33.618510 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618416 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:09:33.618510 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618472 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-service-ca" (OuterVolumeSpecName: "service-ca") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:09:33.618689 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618521 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-config" (OuterVolumeSpecName: "console-config") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:09:33.618794 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618748 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:09:33.618928 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618794 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:33.618928 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618816 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-oauth-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:33.618928 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.618828 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-service-ca\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:33.620597 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.620569 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-kube-api-access-zpbj6" (OuterVolumeSpecName: "kube-api-access-zpbj6") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "kube-api-access-zpbj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:09:33.620808 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.620786 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:09:33.620868 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.620806 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" (UID: "a69a35ad-f1d5-4c22-a7ad-ab205df6bac3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:09:33.719276 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.719214 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-oauth-config\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:33.719276 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.719273 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpbj6\" (UniqueName: \"kubernetes.io/projected/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-kube-api-access-zpbj6\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:33.719276 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.719283 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-trusted-ca-bundle\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:33.719511 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:33.719292 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3-console-serving-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:34.352610 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.352574 2569 generic.go:356] "Generic (PLEG): container finished" podID="a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" containerID="a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96" exitCode=0 Jul 23 19:09:34.353018 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.352619 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f96d546c8-mjtxn" Jul 23 19:09:34.353018 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.352637 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96d546c8-mjtxn" event={"ID":"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3","Type":"ContainerDied","Data":"a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96"} Jul 23 19:09:34.353018 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.352682 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f96d546c8-mjtxn" event={"ID":"a69a35ad-f1d5-4c22-a7ad-ab205df6bac3","Type":"ContainerDied","Data":"3a8e3c7ef50a246c5b0d61df4ba85e827b22d83db7baf7a6163d5879cce19198"} Jul 23 19:09:34.353018 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.352705 2569 scope.go:117] "RemoveContainer" containerID="a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96" Jul 23 19:09:34.362616 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.362593 2569 scope.go:117] "RemoveContainer" containerID="a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96" Jul 23 19:09:34.362905 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:09:34.362883 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96\": container with ID starting with a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96 not found: ID does not exist" containerID="a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96" Jul 23 19:09:34.362963 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.362914 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96"} err="failed to get container status \"a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96\": rpc error: code = NotFound desc = could not find container \"a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96\": container with ID starting with a4b2fce2d64a5bf08f788d8e519de24423e81eb2ed20da2430e9f1da8ce09b96 not found: ID does not exist" Jul 23 19:09:34.375505 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.375473 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f96d546c8-mjtxn"] Jul 23 19:09:34.379670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:34.379645 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f96d546c8-mjtxn"] Jul 23 19:09:35.079483 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:35.079450 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" path="/var/lib/kubelet/pods/a69a35ad-f1d5-4c22-a7ad-ab205df6bac3/volumes" Jul 23 19:09:40.714469 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.714436 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf"] Jul 23 19:09:40.714984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.714964 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" containerName="console" Jul 23 19:09:40.715079 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.714988 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" containerName="console" Jul 23 19:09:40.715133 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.715102 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69a35ad-f1d5-4c22-a7ad-ab205df6bac3" containerName="console" Jul 23 19:09:40.718265 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.718242 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:40.720946 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.720925 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-556q5\"" Jul 23 19:09:40.721039 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.720935 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 19:09:40.721923 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.721904 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 19:09:40.734311 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.734289 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf"] Jul 23 19:09:40.784908 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.784874 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ww5\" (UniqueName: \"kubernetes.io/projected/4c1777cc-5634-4de9-af33-6017f5d83954-kube-api-access-42ww5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:40.785065 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.784934 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c1777cc-5634-4de9-af33-6017f5d83954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:40.886238 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.886184 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ww5\" (UniqueName: \"kubernetes.io/projected/4c1777cc-5634-4de9-af33-6017f5d83954-kube-api-access-42ww5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:40.886433 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.886260 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c1777cc-5634-4de9-af33-6017f5d83954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:40.886671 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.886648 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c1777cc-5634-4de9-af33-6017f5d83954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:40.895995 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:40.895964 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ww5\" (UniqueName: \"kubernetes.io/projected/4c1777cc-5634-4de9-af33-6017f5d83954-kube-api-access-42ww5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:41.029060 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.028969 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:41.165639 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.165602 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf"] Jul 23 19:09:41.169087 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:09:41.169057 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1777cc_5634_4de9_af33_6017f5d83954.slice/crio-b86232e876588c72e4193774113c4ed6aad49d8e1515f12126c5c1d7dcd038f2 WatchSource:0}: Error finding container b86232e876588c72e4193774113c4ed6aad49d8e1515f12126c5c1d7dcd038f2: Status 404 returned error can't find the container with id b86232e876588c72e4193774113c4ed6aad49d8e1515f12126c5c1d7dcd038f2 Jul 23 19:09:41.385748 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.385649 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" event={"ID":"4c1777cc-5634-4de9-af33-6017f5d83954","Type":"ContainerStarted","Data":"b86232e876588c72e4193774113c4ed6aad49d8e1515f12126c5c1d7dcd038f2"} Jul 23 19:09:41.433679 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.433642 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf"] Jul 23 19:09:41.440006 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.439978 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf"] Jul 23 19:09:41.461336 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.461304 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf"] Jul 23 19:09:41.466243 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.466208 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.483199 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.483173 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf"] Jul 23 19:09:41.592201 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.592165 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5c2\" (UniqueName: \"kubernetes.io/projected/ebd4a982-13bd-4ff7-942e-dfa7900210c6-kube-api-access-gj5c2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7psmf\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.592438 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.592334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebd4a982-13bd-4ff7-942e-dfa7900210c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7psmf\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.693487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.693457 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5c2\" (UniqueName: \"kubernetes.io/projected/ebd4a982-13bd-4ff7-942e-dfa7900210c6-kube-api-access-gj5c2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7psmf\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.693636 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.693563 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebd4a982-13bd-4ff7-942e-dfa7900210c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7psmf\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.693981 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.693963 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebd4a982-13bd-4ff7-942e-dfa7900210c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7psmf\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.704972 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.704939 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5c2\" (UniqueName: \"kubernetes.io/projected/ebd4a982-13bd-4ff7-942e-dfa7900210c6-kube-api-access-gj5c2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7psmf\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.777023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.776962 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:41.960875 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:41.960846 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf"] Jul 23 19:09:41.963594 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:09:41.963562 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd4a982_13bd_4ff7_942e_dfa7900210c6.slice/crio-2d199a18c9a3b4049e77207fa78f98879bc7b8325ae418928f44f81c1ab42280 WatchSource:0}: Error finding container 2d199a18c9a3b4049e77207fa78f98879bc7b8325ae418928f44f81c1ab42280: Status 404 returned error can't find the container with id 2d199a18c9a3b4049e77207fa78f98879bc7b8325ae418928f44f81c1ab42280 Jul 23 19:09:42.395837 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:42.395758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" event={"ID":"ebd4a982-13bd-4ff7-942e-dfa7900210c6","Type":"ContainerStarted","Data":"2d199a18c9a3b4049e77207fa78f98879bc7b8325ae418928f44f81c1ab42280"} Jul 23 19:09:46.420423 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.420313 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" containerName="manager" containerID="cri-o://be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df" gracePeriod=2 Jul 23 19:09:46.421997 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.421961 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" event={"ID":"ebd4a982-13bd-4ff7-942e-dfa7900210c6","Type":"ContainerStarted","Data":"69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675"} Jul 23 19:09:46.422193 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.422173 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:09:46.456392 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.456324 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" podStartSLOduration=1.443500943 podStartE2EDuration="5.456303918s" totalImagesPullingTime="4.012802975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:09:46.455149435 +0000 UTC m=+513.879147629" watchObservedRunningTime="2026-07-23 19:09:46.456303918 +0000 UTC m=+513.880302110" Jul 23 19:09:46.670415 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.670387 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:46.674530 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:09:46.674470 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" is forbidden: User \"system:node:ip-10-0-128-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-42.ec2.internal' and this object" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:46.739937 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.739904 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c1777cc-5634-4de9-af33-6017f5d83954-extensions-socket-volume\") pod \"4c1777cc-5634-4de9-af33-6017f5d83954\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " Jul 23 19:09:46.740103 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.740008 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42ww5\" (UniqueName: \"kubernetes.io/projected/4c1777cc-5634-4de9-af33-6017f5d83954-kube-api-access-42ww5\") pod \"4c1777cc-5634-4de9-af33-6017f5d83954\" (UID: \"4c1777cc-5634-4de9-af33-6017f5d83954\") " Jul 23 19:09:46.740220 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.740194 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1777cc-5634-4de9-af33-6017f5d83954-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4c1777cc-5634-4de9-af33-6017f5d83954" (UID: "4c1777cc-5634-4de9-af33-6017f5d83954"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 19:09:46.742141 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.742109 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1777cc-5634-4de9-af33-6017f5d83954-kube-api-access-42ww5" (OuterVolumeSpecName: "kube-api-access-42ww5") pod "4c1777cc-5634-4de9-af33-6017f5d83954" (UID: "4c1777cc-5634-4de9-af33-6017f5d83954"). InnerVolumeSpecName "kube-api-access-42ww5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:09:46.841651 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.841611 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42ww5\" (UniqueName: \"kubernetes.io/projected/4c1777cc-5634-4de9-af33-6017f5d83954-kube-api-access-42ww5\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:46.841651 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:46.841643 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c1777cc-5634-4de9-af33-6017f5d83954-extensions-socket-volume\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:09:47.079090 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:47.079056 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" path="/var/lib/kubelet/pods/4c1777cc-5634-4de9-af33-6017f5d83954/volumes" Jul 23 19:09:47.428604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:47.428520 2569 generic.go:356] "Generic (PLEG): container finished" podID="4c1777cc-5634-4de9-af33-6017f5d83954" containerID="be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df" exitCode=2 Jul 23 19:09:47.428604 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:47.428563 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:47.429069 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:47.428617 2569 scope.go:117] "RemoveContainer" containerID="be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df" Jul 23 19:09:47.433418 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:09:47.433391 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mj5bf\" is forbidden: User \"system:node:ip-10-0-128-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-42.ec2.internal' and this object" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mj5bf" Jul 23 19:09:47.438163 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:47.438140 2569 scope.go:117] "RemoveContainer" containerID="be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df" Jul 23 19:09:47.438476 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:09:47.438453 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df\": container with ID starting with be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df not found: ID does not exist" containerID="be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df" Jul 23 19:09:47.438555 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:47.438489 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df"} err="failed to get container status \"be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df\": rpc error: code = NotFound desc = could not find container \"be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df\": container with ID starting with be119e92c20766d99ea6b0499a9e5a7d7d7561e17af2e567f6e6e2e40484c1df not found: ID does not exist" Jul 23 19:09:57.430686 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:09:57.430655 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:10:09.976930 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:09.976845 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf"] Jul 23 19:10:09.977477 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:09.977040 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" podUID="ebd4a982-13bd-4ff7-942e-dfa7900210c6" containerName="manager" containerID="cri-o://69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675" gracePeriod=10 Jul 23 19:10:10.223004 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.222979 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:10:10.259605 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.259525 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj5c2\" (UniqueName: \"kubernetes.io/projected/ebd4a982-13bd-4ff7-942e-dfa7900210c6-kube-api-access-gj5c2\") pod \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " Jul 23 19:10:10.259760 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.259612 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebd4a982-13bd-4ff7-942e-dfa7900210c6-extensions-socket-volume\") pod \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\" (UID: \"ebd4a982-13bd-4ff7-942e-dfa7900210c6\") " Jul 23 19:10:10.260184 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.260153 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd4a982-13bd-4ff7-942e-dfa7900210c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ebd4a982-13bd-4ff7-942e-dfa7900210c6" (UID: "ebd4a982-13bd-4ff7-942e-dfa7900210c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 19:10:10.261663 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.261637 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd4a982-13bd-4ff7-942e-dfa7900210c6-kube-api-access-gj5c2" (OuterVolumeSpecName: "kube-api-access-gj5c2") pod "ebd4a982-13bd-4ff7-942e-dfa7900210c6" (UID: "ebd4a982-13bd-4ff7-942e-dfa7900210c6"). InnerVolumeSpecName "kube-api-access-gj5c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:10:10.360235 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.360199 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj5c2\" (UniqueName: \"kubernetes.io/projected/ebd4a982-13bd-4ff7-942e-dfa7900210c6-kube-api-access-gj5c2\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:10:10.360410 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.360256 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebd4a982-13bd-4ff7-942e-dfa7900210c6-extensions-socket-volume\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:10:10.542264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.542156 2569 generic.go:356] "Generic (PLEG): container finished" podID="ebd4a982-13bd-4ff7-942e-dfa7900210c6" containerID="69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675" exitCode=0 Jul 23 19:10:10.542264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.542205 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" Jul 23 19:10:10.542264 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.542250 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" event={"ID":"ebd4a982-13bd-4ff7-942e-dfa7900210c6","Type":"ContainerDied","Data":"69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675"} Jul 23 19:10:10.542487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.542306 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf" event={"ID":"ebd4a982-13bd-4ff7-942e-dfa7900210c6","Type":"ContainerDied","Data":"2d199a18c9a3b4049e77207fa78f98879bc7b8325ae418928f44f81c1ab42280"} Jul 23 19:10:10.542487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.542328 2569 scope.go:117] "RemoveContainer" containerID="69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675" Jul 23 19:10:10.556310 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.556290 2569 scope.go:117] "RemoveContainer" containerID="69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675" Jul 23 19:10:10.556598 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:10:10.556576 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675\": container with ID starting with 69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675 not found: ID does not exist" containerID="69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675" Jul 23 19:10:10.556695 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.556605 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675"} err="failed to get container status \"69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675\": rpc error: code = NotFound desc = could not find container \"69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675\": container with ID starting with 69b544fabff164e92e32e556f564ccda679b424bfdbe3c99425fbe23943ec675 not found: ID does not exist" Jul 23 19:10:10.578197 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.578164 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf"] Jul 23 19:10:10.582601 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:10.582575 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7psmf"] Jul 23 19:10:11.078743 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:11.078701 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd4a982-13bd-4ff7-942e-dfa7900210c6" path="/var/lib/kubelet/pods/ebd4a982-13bd-4ff7-942e-dfa7900210c6/volumes" Jul 23 19:10:32.325563 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.325530 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:32.325960 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.325938 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" containerName="manager" Jul 23 19:10:32.325960 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.325950 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" containerName="manager" Jul 23 19:10:32.326037 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.325964 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd4a982-13bd-4ff7-942e-dfa7900210c6" containerName="manager" Jul 23 19:10:32.326037 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.325970 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd4a982-13bd-4ff7-942e-dfa7900210c6" containerName="manager" Jul 23 19:10:32.326096 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.326047 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1777cc-5634-4de9-af33-6017f5d83954" containerName="manager" Jul 23 19:10:32.326096 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.326058 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd4a982-13bd-4ff7-942e-dfa7900210c6" containerName="manager" Jul 23 19:10:32.329864 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.329837 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.332396 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.332358 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 19:10:32.332535 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.332382 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zpxm7\"" Jul 23 19:10:32.332535 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.332485 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 19:10:32.333191 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.333173 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 19:10:32.341484 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.341453 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:32.383035 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.382999 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:32.457664 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.457615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8z9\" (UniqueName: \"kubernetes.io/projected/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-kube-api-access-7d8z9\") pod \"limitador-limitador-64c94fd64f-tnrbt\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.457855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.457673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-config-file\") pod \"limitador-limitador-64c94fd64f-tnrbt\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.558687 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.558637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8z9\" (UniqueName: \"kubernetes.io/projected/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-kube-api-access-7d8z9\") pod \"limitador-limitador-64c94fd64f-tnrbt\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.558687 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.558695 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-config-file\") pod \"limitador-limitador-64c94fd64f-tnrbt\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.559405 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.559384 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-config-file\") pod \"limitador-limitador-64c94fd64f-tnrbt\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.570638 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.570608 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8z9\" (UniqueName: \"kubernetes.io/projected/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-kube-api-access-7d8z9\") pod \"limitador-limitador-64c94fd64f-tnrbt\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.642451 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.642352 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:32.781880 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:32.781857 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:32.783706 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:10:32.783680 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c4b9f5_3d88_4bfb_b2db_c53e4103cc04.slice/crio-446740919e8ed43caadeac813dc68cd7c488fc986bc866666d4af6acbb42a454 WatchSource:0}: Error finding container 446740919e8ed43caadeac813dc68cd7c488fc986bc866666d4af6acbb42a454: Status 404 returned error can't find the container with id 446740919e8ed43caadeac813dc68cd7c488fc986bc866666d4af6acbb42a454 Jul 23 19:10:33.107480 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.107444 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-25flz"] Jul 23 19:10:33.110649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.110627 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:33.113649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.113628 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jgw2m\"" Jul 23 19:10:33.120948 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.120928 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-25flz"] Jul 23 19:10:33.163887 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.163852 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgqz\" (UniqueName: \"kubernetes.io/projected/f044e187-36c5-4b84-a15c-e683d4bd23e1-kube-api-access-mfgqz\") pod \"authorino-58cd955675-25flz\" (UID: \"f044e187-36c5-4b84-a15c-e683d4bd23e1\") " pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:33.264581 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.264542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgqz\" (UniqueName: \"kubernetes.io/projected/f044e187-36c5-4b84-a15c-e683d4bd23e1-kube-api-access-mfgqz\") pod \"authorino-58cd955675-25flz\" (UID: \"f044e187-36c5-4b84-a15c-e683d4bd23e1\") " pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:33.275242 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.275194 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgqz\" (UniqueName: \"kubernetes.io/projected/f044e187-36c5-4b84-a15c-e683d4bd23e1-kube-api-access-mfgqz\") pod \"authorino-58cd955675-25flz\" (UID: \"f044e187-36c5-4b84-a15c-e683d4bd23e1\") " pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:33.348190 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.348151 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkstg"] Jul 23 19:10:33.351109 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.351086 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:10:33.360008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.359983 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkstg"] Jul 23 19:10:33.419934 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.419752 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:33.484038 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.483883 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6pl9\" (UniqueName: \"kubernetes.io/projected/84853fd3-20e7-490f-8f4b-cbe0174fd631-kube-api-access-m6pl9\") pod \"authorino-75d556bd77-zkstg\" (UID: \"84853fd3-20e7-490f-8f4b-cbe0174fd631\") " pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:10:33.585599 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.585561 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6pl9\" (UniqueName: \"kubernetes.io/projected/84853fd3-20e7-490f-8f4b-cbe0174fd631-kube-api-access-m6pl9\") pod \"authorino-75d556bd77-zkstg\" (UID: \"84853fd3-20e7-490f-8f4b-cbe0174fd631\") " pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:10:33.594898 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.594835 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6pl9\" (UniqueName: \"kubernetes.io/projected/84853fd3-20e7-490f-8f4b-cbe0174fd631-kube-api-access-m6pl9\") pod \"authorino-75d556bd77-zkstg\" (UID: \"84853fd3-20e7-490f-8f4b-cbe0174fd631\") " pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:10:33.601827 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.601796 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-25flz"] Jul 23 19:10:33.660629 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.660600 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:10:33.662932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.662898 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25flz" event={"ID":"f044e187-36c5-4b84-a15c-e683d4bd23e1","Type":"ContainerStarted","Data":"a1d09be31ffb1e55bc338c56686a166ad5247528e3b42c91bf18bb19d90e18c7"} Jul 23 19:10:33.665413 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.665314 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" event={"ID":"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04","Type":"ContainerStarted","Data":"446740919e8ed43caadeac813dc68cd7c488fc986bc866666d4af6acbb42a454"} Jul 23 19:10:33.865056 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:33.865032 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkstg"] Jul 23 19:10:33.868042 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:10:33.868010 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84853fd3_20e7_490f_8f4b_cbe0174fd631.slice/crio-65f0d2db5f40c68d5ff52e0812049847989bb9998c7a20942d1c5fd1c8f8ae82 WatchSource:0}: Error finding container 65f0d2db5f40c68d5ff52e0812049847989bb9998c7a20942d1c5fd1c8f8ae82: Status 404 returned error can't find the container with id 65f0d2db5f40c68d5ff52e0812049847989bb9998c7a20942d1c5fd1c8f8ae82 Jul 23 19:10:34.671237 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:34.671186 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkstg" event={"ID":"84853fd3-20e7-490f-8f4b-cbe0174fd631","Type":"ContainerStarted","Data":"65f0d2db5f40c68d5ff52e0812049847989bb9998c7a20942d1c5fd1c8f8ae82"} Jul 23 19:10:36.685104 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:36.685066 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" event={"ID":"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04","Type":"ContainerStarted","Data":"4e34f715dce207ed0cc7d3c5259ce06385b3f2b55fada27fafef59a195eb7e0d"} Jul 23 19:10:36.685641 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:36.685201 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:36.703998 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:36.703940 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" podStartSLOduration=1.6767056280000001 podStartE2EDuration="4.703919225s" totalImagesPullingTime="3.027213597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:10:36.703015708 +0000 UTC m=+564.127013901" watchObservedRunningTime="2026-07-23 19:10:36.703919225 +0000 UTC m=+564.127917418" Jul 23 19:10:38.695842 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:38.695805 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25flz" event={"ID":"f044e187-36c5-4b84-a15c-e683d4bd23e1","Type":"ContainerStarted","Data":"a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc"} Jul 23 19:10:38.697189 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:38.697163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkstg" event={"ID":"84853fd3-20e7-490f-8f4b-cbe0174fd631","Type":"ContainerStarted","Data":"a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e"} Jul 23 19:10:38.712886 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:38.712839 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-25flz" podStartSLOduration=1.314315782 podStartE2EDuration="5.712821845s" totalImagesPullingTime="4.398506063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:10:38.711808694 +0000 UTC m=+566.135806886" watchObservedRunningTime="2026-07-23 19:10:38.712821845 +0000 UTC m=+566.136820038" Jul 23 19:10:38.727907 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:38.727859 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zkstg" podStartSLOduration=1.602685126 podStartE2EDuration="5.727844679s" totalImagesPullingTime="4.125159553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:10:38.726666144 +0000 UTC m=+566.150664339" watchObservedRunningTime="2026-07-23 19:10:38.727844679 +0000 UTC m=+566.151842871" Jul 23 19:10:38.756934 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:38.756904 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-25flz"] Jul 23 19:10:40.705993 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:40.705949 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-25flz" podUID="f044e187-36c5-4b84-a15c-e683d4bd23e1" containerName="authorino" containerID="cri-o://a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc" gracePeriod=30 Jul 23 19:10:40.944892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:40.944863 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:41.062809 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.062729 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfgqz\" (UniqueName: \"kubernetes.io/projected/f044e187-36c5-4b84-a15c-e683d4bd23e1-kube-api-access-mfgqz\") pod \"f044e187-36c5-4b84-a15c-e683d4bd23e1\" (UID: \"f044e187-36c5-4b84-a15c-e683d4bd23e1\") " Jul 23 19:10:41.064717 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.064694 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f044e187-36c5-4b84-a15c-e683d4bd23e1-kube-api-access-mfgqz" (OuterVolumeSpecName: "kube-api-access-mfgqz") pod "f044e187-36c5-4b84-a15c-e683d4bd23e1" (UID: "f044e187-36c5-4b84-a15c-e683d4bd23e1"). InnerVolumeSpecName "kube-api-access-mfgqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:10:41.163969 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.163936 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfgqz\" (UniqueName: \"kubernetes.io/projected/f044e187-36c5-4b84-a15c-e683d4bd23e1-kube-api-access-mfgqz\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:10:41.711379 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.711340 2569 generic.go:356] "Generic (PLEG): container finished" podID="f044e187-36c5-4b84-a15c-e683d4bd23e1" containerID="a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc" exitCode=0 Jul 23 19:10:41.711379 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.711381 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25flz" Jul 23 19:10:41.711822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.711390 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25flz" event={"ID":"f044e187-36c5-4b84-a15c-e683d4bd23e1","Type":"ContainerDied","Data":"a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc"} Jul 23 19:10:41.711822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.711428 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25flz" event={"ID":"f044e187-36c5-4b84-a15c-e683d4bd23e1","Type":"ContainerDied","Data":"a1d09be31ffb1e55bc338c56686a166ad5247528e3b42c91bf18bb19d90e18c7"} Jul 23 19:10:41.711822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.711466 2569 scope.go:117] "RemoveContainer" containerID="a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc" Jul 23 19:10:41.719684 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.719666 2569 scope.go:117] "RemoveContainer" containerID="a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc" Jul 23 19:10:41.719941 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:10:41.719918 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc\": container with ID starting with a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc not found: ID does not exist" containerID="a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc" Jul 23 19:10:41.720009 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.719954 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc"} err="failed to get container status \"a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc\": rpc error: code = NotFound desc = could not find container \"a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc\": container with ID starting with a882f936b225972c7d43678eba3328c5870c49d6a79f245262080749a8c585fc not found: ID does not exist" Jul 23 19:10:41.726985 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.726957 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-25flz"] Jul 23 19:10:41.731095 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:41.731070 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-25flz"] Jul 23 19:10:43.079277 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:43.079245 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f044e187-36c5-4b84-a15c-e683d4bd23e1" path="/var/lib/kubelet/pods/f044e187-36c5-4b84-a15c-e683d4bd23e1/volumes" Jul 23 19:10:47.177887 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:47.177852 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:47.178388 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:47.178075 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" podUID="52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" containerName="limitador" containerID="cri-o://4e34f715dce207ed0cc7d3c5259ce06385b3f2b55fada27fafef59a195eb7e0d" gracePeriod=30 Jul 23 19:10:47.179372 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:47.179345 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:47.744138 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:47.744058 2569 generic.go:356] "Generic (PLEG): container finished" podID="52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" containerID="4e34f715dce207ed0cc7d3c5259ce06385b3f2b55fada27fafef59a195eb7e0d" exitCode=0 Jul 23 19:10:47.744138 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:47.744093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" event={"ID":"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04","Type":"ContainerDied","Data":"4e34f715dce207ed0cc7d3c5259ce06385b3f2b55fada27fafef59a195eb7e0d"} Jul 23 19:10:48.128989 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.128965 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:48.232220 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.232178 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-config-file\") pod \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " Jul 23 19:10:48.232714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.232290 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8z9\" (UniqueName: \"kubernetes.io/projected/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-kube-api-access-7d8z9\") pod \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\" (UID: \"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04\") " Jul 23 19:10:48.232714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.232531 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-config-file" (OuterVolumeSpecName: "config-file") pod "52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" (UID: "52c4b9f5-3d88-4bfb-b2db-c53e4103cc04"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 19:10:48.232714 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.232613 2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-config-file\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:10:48.234343 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.234314 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-kube-api-access-7d8z9" (OuterVolumeSpecName: "kube-api-access-7d8z9") pod "52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" (UID: "52c4b9f5-3d88-4bfb-b2db-c53e4103cc04"). InnerVolumeSpecName "kube-api-access-7d8z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:10:48.333664 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.333578 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d8z9\" (UniqueName: \"kubernetes.io/projected/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04-kube-api-access-7d8z9\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:10:48.749655 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.749627 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" Jul 23 19:10:48.749831 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.749666 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tnrbt" event={"ID":"52c4b9f5-3d88-4bfb-b2db-c53e4103cc04","Type":"ContainerDied","Data":"446740919e8ed43caadeac813dc68cd7c488fc986bc866666d4af6acbb42a454"} Jul 23 19:10:48.749831 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.749738 2569 scope.go:117] "RemoveContainer" containerID="4e34f715dce207ed0cc7d3c5259ce06385b3f2b55fada27fafef59a195eb7e0d" Jul 23 19:10:48.770405 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.770378 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:48.773142 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:48.773120 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tnrbt"] Jul 23 19:10:49.079736 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:49.079655 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" path="/var/lib/kubelet/pods/52c4b9f5-3d88-4bfb-b2db-c53e4103cc04/volumes" Jul 23 19:10:53.491911 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.491873 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-78mcf"] Jul 23 19:10:53.492324 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.492310 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f044e187-36c5-4b84-a15c-e683d4bd23e1" containerName="authorino" Jul 23 19:10:53.492372 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.492326 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f044e187-36c5-4b84-a15c-e683d4bd23e1" containerName="authorino" Jul 23 19:10:53.492372 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.492346 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" containerName="limitador" Jul 23 19:10:53.492372 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.492352 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" containerName="limitador" Jul 23 19:10:53.492461 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.492406 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f044e187-36c5-4b84-a15c-e683d4bd23e1" containerName="authorino" Jul 23 19:10:53.492461 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.492418 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c4b9f5-3d88-4bfb-b2db-c53e4103cc04" containerName="limitador" Jul 23 19:10:53.496801 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.496782 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.499532 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.499503 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 19:10:53.499532 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.499562 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 19:10:53.500565 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.500549 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 19:10:53.500659 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.500607 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-z8sjw\"" Jul 23 19:10:53.506172 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.506146 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-78mcf"] Jul 23 19:10:53.580643 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.580602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-998nv\" (UniqueName: \"kubernetes.io/projected/93b94b4f-f4dd-44f7-89a4-703de5824bd4-kube-api-access-998nv\") pod \"postgres-69fb4594cf-78mcf\" (UID: \"93b94b4f-f4dd-44f7-89a4-703de5824bd4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.580643 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.580646 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/93b94b4f-f4dd-44f7-89a4-703de5824bd4-data\") pod \"postgres-69fb4594cf-78mcf\" (UID: \"93b94b4f-f4dd-44f7-89a4-703de5824bd4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.681457 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.681425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-998nv\" (UniqueName: \"kubernetes.io/projected/93b94b4f-f4dd-44f7-89a4-703de5824bd4-kube-api-access-998nv\") pod \"postgres-69fb4594cf-78mcf\" (UID: \"93b94b4f-f4dd-44f7-89a4-703de5824bd4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.681457 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.681461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/93b94b4f-f4dd-44f7-89a4-703de5824bd4-data\") pod \"postgres-69fb4594cf-78mcf\" (UID: \"93b94b4f-f4dd-44f7-89a4-703de5824bd4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.681837 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.681821 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/93b94b4f-f4dd-44f7-89a4-703de5824bd4-data\") pod \"postgres-69fb4594cf-78mcf\" (UID: \"93b94b4f-f4dd-44f7-89a4-703de5824bd4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.689924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.689896 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-998nv\" (UniqueName: \"kubernetes.io/projected/93b94b4f-f4dd-44f7-89a4-703de5824bd4-kube-api-access-998nv\") pod \"postgres-69fb4594cf-78mcf\" (UID: \"93b94b4f-f4dd-44f7-89a4-703de5824bd4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.808069 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.807968 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:53.939733 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:53.939708 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-78mcf"] Jul 23 19:10:53.941377 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:10:53.941347 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b94b4f_f4dd_44f7_89a4_703de5824bd4.slice/crio-304f43a8ed22ea3796588ea2d4211ffd82d6b6e58d4490803d86db42337e59ec WatchSource:0}: Error finding container 304f43a8ed22ea3796588ea2d4211ffd82d6b6e58d4490803d86db42337e59ec: Status 404 returned error can't find the container with id 304f43a8ed22ea3796588ea2d4211ffd82d6b6e58d4490803d86db42337e59ec Jul 23 19:10:54.782988 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:54.782949 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" event={"ID":"93b94b4f-f4dd-44f7-89a4-703de5824bd4","Type":"ContainerStarted","Data":"304f43a8ed22ea3796588ea2d4211ffd82d6b6e58d4490803d86db42337e59ec"} Jul 23 19:10:59.811053 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:59.811014 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" event={"ID":"93b94b4f-f4dd-44f7-89a4-703de5824bd4","Type":"ContainerStarted","Data":"999700154aa5475d67d4975d8338aebaf813f6a77aac292c97e49d5a9323515f"} Jul 23 19:10:59.811460 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:59.811089 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:10:59.829461 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:10:59.829402 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" podStartSLOduration=1.998297861 podStartE2EDuration="6.829383709s" totalImagesPullingTime="4.831085848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:10:59.82779793 +0000 UTC m=+587.251796135" watchObservedRunningTime="2026-07-23 19:10:59.829383709 +0000 UTC m=+587.253381902" Jul 23 19:11:05.846170 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:05.846138 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-78mcf" Jul 23 19:11:06.405550 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.405510 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vlwwt"] Jul 23 19:11:06.409198 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.409175 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:06.418578 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.418550 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vlwwt"] Jul 23 19:11:06.505855 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.505809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t84lr\" (UniqueName: \"kubernetes.io/projected/19dda885-2c62-4c3e-a1e0-f86143fb968a-kube-api-access-t84lr\") pod \"authorino-5d4b67c446-vlwwt\" (UID: \"19dda885-2c62-4c3e-a1e0-f86143fb968a\") " pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:06.607282 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.607242 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t84lr\" (UniqueName: \"kubernetes.io/projected/19dda885-2c62-4c3e-a1e0-f86143fb968a-kube-api-access-t84lr\") pod \"authorino-5d4b67c446-vlwwt\" (UID: \"19dda885-2c62-4c3e-a1e0-f86143fb968a\") " pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:06.616103 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.616061 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t84lr\" (UniqueName: \"kubernetes.io/projected/19dda885-2c62-4c3e-a1e0-f86143fb968a-kube-api-access-t84lr\") pod \"authorino-5d4b67c446-vlwwt\" (UID: \"19dda885-2c62-4c3e-a1e0-f86143fb968a\") " pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:06.644828 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.644790 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vlwwt"] Jul 23 19:11:06.645091 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.645078 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:06.675886 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.675854 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56649d9c47-vx7nf"] Jul 23 19:11:06.679559 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.679540 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:06.688339 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.688307 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56649d9c47-vx7nf"] Jul 23 19:11:06.787126 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.787096 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vlwwt"] Jul 23 19:11:06.789082 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:06.789053 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19dda885_2c62_4c3e_a1e0_f86143fb968a.slice/crio-518ed8f754629f11c965b94ff37c87345d44a846114e3ab54ae4438f9592c4df WatchSource:0}: Error finding container 518ed8f754629f11c965b94ff37c87345d44a846114e3ab54ae4438f9592c4df: Status 404 returned error can't find the container with id 518ed8f754629f11c965b94ff37c87345d44a846114e3ab54ae4438f9592c4df Jul 23 19:11:06.809466 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.809429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crz6g\" (UniqueName: \"kubernetes.io/projected/8c066926-ade0-46b4-aed4-4ed8be95f491-kube-api-access-crz6g\") pod \"authorino-56649d9c47-vx7nf\" (UID: \"8c066926-ade0-46b4-aed4-4ed8be95f491\") " pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:06.844696 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.844665 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" event={"ID":"19dda885-2c62-4c3e-a1e0-f86143fb968a","Type":"ContainerStarted","Data":"518ed8f754629f11c965b94ff37c87345d44a846114e3ab54ae4438f9592c4df"} Jul 23 19:11:06.910500 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.910403 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crz6g\" (UniqueName: \"kubernetes.io/projected/8c066926-ade0-46b4-aed4-4ed8be95f491-kube-api-access-crz6g\") pod \"authorino-56649d9c47-vx7nf\" (UID: \"8c066926-ade0-46b4-aed4-4ed8be95f491\") " pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:06.921335 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.921307 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crz6g\" (UniqueName: \"kubernetes.io/projected/8c066926-ade0-46b4-aed4-4ed8be95f491-kube-api-access-crz6g\") pod \"authorino-56649d9c47-vx7nf\" (UID: \"8c066926-ade0-46b4-aed4-4ed8be95f491\") " pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:06.991371 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:06.991331 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:07.129509 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.129482 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56649d9c47-vx7nf"] Jul 23 19:11:07.131798 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:07.131766 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c066926_ade0_46b4_aed4_4ed8be95f491.slice/crio-a9dbfe4273846905b34169d4bcbc266d55a7961eb780726aefc02b9fa9aeb2fe WatchSource:0}: Error finding container a9dbfe4273846905b34169d4bcbc266d55a7961eb780726aefc02b9fa9aeb2fe: Status 404 returned error can't find the container with id a9dbfe4273846905b34169d4bcbc266d55a7961eb780726aefc02b9fa9aeb2fe Jul 23 19:11:07.209037 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.209000 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56649d9c47-vx7nf"] Jul 23 19:11:07.247566 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.247534 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-667dc5cdb7-bnbz8"] Jul 23 19:11:07.252074 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.252055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.254551 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.254530 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 19:11:07.260262 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.260218 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667dc5cdb7-bnbz8"] Jul 23 19:11:07.414984 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.414954 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z67\" (UniqueName: \"kubernetes.io/projected/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-kube-api-access-r8z67\") pod \"authorino-667dc5cdb7-bnbz8\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.415127 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.415076 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-tls-cert\") pod \"authorino-667dc5cdb7-bnbz8\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.516034 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.516008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-tls-cert\") pod \"authorino-667dc5cdb7-bnbz8\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.516188 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.516172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z67\" (UniqueName: \"kubernetes.io/projected/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-kube-api-access-r8z67\") pod \"authorino-667dc5cdb7-bnbz8\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.518668 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.518643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-tls-cert\") pod \"authorino-667dc5cdb7-bnbz8\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.527245 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.527202 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z67\" (UniqueName: \"kubernetes.io/projected/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-kube-api-access-r8z67\") pod \"authorino-667dc5cdb7-bnbz8\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.562297 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.562267 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:11:07.715756 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.715725 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667dc5cdb7-bnbz8"] Jul 23 19:11:07.717759 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:07.717723 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78b56c8e_d5b6_4b79_a891_3a2c12f1259f.slice/crio-1b5d8a9e0d458e060fe0e11ec0a9ae1e8146c0662f75822fa4d94f938591e512 WatchSource:0}: Error finding container 1b5d8a9e0d458e060fe0e11ec0a9ae1e8146c0662f75822fa4d94f938591e512: Status 404 returned error can't find the container with id 1b5d8a9e0d458e060fe0e11ec0a9ae1e8146c0662f75822fa4d94f938591e512 Jul 23 19:11:07.851540 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.851432 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" event={"ID":"19dda885-2c62-4c3e-a1e0-f86143fb968a","Type":"ContainerStarted","Data":"0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629"} Jul 23 19:11:07.851540 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.851441 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" podUID="19dda885-2c62-4c3e-a1e0-f86143fb968a" containerName="authorino" containerID="cri-o://0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629" gracePeriod=30 Jul 23 19:11:07.852769 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.852742 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" event={"ID":"78b56c8e-d5b6-4b79-a891-3a2c12f1259f","Type":"ContainerStarted","Data":"1b5d8a9e0d458e060fe0e11ec0a9ae1e8146c0662f75822fa4d94f938591e512"} Jul 23 19:11:07.854283 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.854210 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56649d9c47-vx7nf" event={"ID":"8c066926-ade0-46b4-aed4-4ed8be95f491","Type":"ContainerStarted","Data":"a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c"} Jul 23 19:11:07.854283 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.854266 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56649d9c47-vx7nf" event={"ID":"8c066926-ade0-46b4-aed4-4ed8be95f491","Type":"ContainerStarted","Data":"a9dbfe4273846905b34169d4bcbc266d55a7961eb780726aefc02b9fa9aeb2fe"} Jul 23 19:11:07.854475 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.854313 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56649d9c47-vx7nf" podUID="8c066926-ade0-46b4-aed4-4ed8be95f491" containerName="authorino" containerID="cri-o://a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c" gracePeriod=30 Jul 23 19:11:07.870415 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.870356 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" podStartSLOduration=1.28502523 podStartE2EDuration="1.870333912s" totalImagesPullingTime="585.308682ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:07.868815347 +0000 UTC m=+595.292813538" watchObservedRunningTime="2026-07-23 19:11:07.870333912 +0000 UTC m=+595.294332105" Jul 23 19:11:07.885659 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:07.885608 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56649d9c47-vx7nf" podStartSLOduration=1.516553187 podStartE2EDuration="1.885590398s" totalImagesPullingTime="369.037211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:07.884962415 +0000 UTC m=+595.308960608" watchObservedRunningTime="2026-07-23 19:11:07.885590398 +0000 UTC m=+595.309588591" Jul 23 19:11:08.121882 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.121857 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:08.125399 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.125376 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:08.223136 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.223091 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t84lr\" (UniqueName: \"kubernetes.io/projected/19dda885-2c62-4c3e-a1e0-f86143fb968a-kube-api-access-t84lr\") pod \"19dda885-2c62-4c3e-a1e0-f86143fb968a\" (UID: \"19dda885-2c62-4c3e-a1e0-f86143fb968a\") " Jul 23 19:11:08.223347 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.223180 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crz6g\" (UniqueName: \"kubernetes.io/projected/8c066926-ade0-46b4-aed4-4ed8be95f491-kube-api-access-crz6g\") pod \"8c066926-ade0-46b4-aed4-4ed8be95f491\" (UID: \"8c066926-ade0-46b4-aed4-4ed8be95f491\") " Jul 23 19:11:08.225219 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.225188 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19dda885-2c62-4c3e-a1e0-f86143fb968a-kube-api-access-t84lr" (OuterVolumeSpecName: "kube-api-access-t84lr") pod "19dda885-2c62-4c3e-a1e0-f86143fb968a" (UID: "19dda885-2c62-4c3e-a1e0-f86143fb968a"). InnerVolumeSpecName "kube-api-access-t84lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:11:08.225353 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.225329 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c066926-ade0-46b4-aed4-4ed8be95f491-kube-api-access-crz6g" (OuterVolumeSpecName: "kube-api-access-crz6g") pod "8c066926-ade0-46b4-aed4-4ed8be95f491" (UID: "8c066926-ade0-46b4-aed4-4ed8be95f491"). InnerVolumeSpecName "kube-api-access-crz6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:11:08.324347 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.324305 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t84lr\" (UniqueName: \"kubernetes.io/projected/19dda885-2c62-4c3e-a1e0-f86143fb968a-kube-api-access-t84lr\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:11:08.324347 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.324342 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crz6g\" (UniqueName: \"kubernetes.io/projected/8c066926-ade0-46b4-aed4-4ed8be95f491-kube-api-access-crz6g\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:11:08.860531 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.860490 2569 generic.go:356] "Generic (PLEG): container finished" podID="19dda885-2c62-4c3e-a1e0-f86143fb968a" containerID="0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629" exitCode=0 Jul 23 19:11:08.860706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.860537 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" Jul 23 19:11:08.860706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.860577 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" event={"ID":"19dda885-2c62-4c3e-a1e0-f86143fb968a","Type":"ContainerDied","Data":"0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629"} Jul 23 19:11:08.860706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.860621 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vlwwt" event={"ID":"19dda885-2c62-4c3e-a1e0-f86143fb968a","Type":"ContainerDied","Data":"518ed8f754629f11c965b94ff37c87345d44a846114e3ab54ae4438f9592c4df"} Jul 23 19:11:08.860706 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.860640 2569 scope.go:117] "RemoveContainer" containerID="0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629" Jul 23 19:11:08.862269 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.862215 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" event={"ID":"78b56c8e-d5b6-4b79-a891-3a2c12f1259f","Type":"ContainerStarted","Data":"02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30"} Jul 23 19:11:08.863565 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.863543 2569 generic.go:356] "Generic (PLEG): container finished" podID="8c066926-ade0-46b4-aed4-4ed8be95f491" containerID="a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c" exitCode=0 Jul 23 19:11:08.863665 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.863571 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56649d9c47-vx7nf" Jul 23 19:11:08.863665 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.863594 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56649d9c47-vx7nf" event={"ID":"8c066926-ade0-46b4-aed4-4ed8be95f491","Type":"ContainerDied","Data":"a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c"} Jul 23 19:11:08.863665 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.863622 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56649d9c47-vx7nf" event={"ID":"8c066926-ade0-46b4-aed4-4ed8be95f491","Type":"ContainerDied","Data":"a9dbfe4273846905b34169d4bcbc266d55a7961eb780726aefc02b9fa9aeb2fe"} Jul 23 19:11:08.869747 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.869727 2569 scope.go:117] "RemoveContainer" containerID="0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629" Jul 23 19:11:08.870049 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:08.870028 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629\": container with ID starting with 0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629 not found: ID does not exist" containerID="0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629" Jul 23 19:11:08.870126 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.870065 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629"} err="failed to get container status \"0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629\": rpc error: code = NotFound desc = could not find container \"0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629\": container with ID starting with 0a9e4e903d45d99a4d73d1b992f33c23fac139d897552a0fcd30d79905b46629 not found: ID does not exist" Jul 23 19:11:08.870126 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.870085 2569 scope.go:117] "RemoveContainer" containerID="a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c" Jul 23 19:11:08.878351 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.878321 2569 scope.go:117] "RemoveContainer" containerID="a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c" Jul 23 19:11:08.878661 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:08.878641 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c\": container with ID starting with a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c not found: ID does not exist" containerID="a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c" Jul 23 19:11:08.878731 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.878671 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c"} err="failed to get container status \"a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c\": rpc error: code = NotFound desc = could not find container \"a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c\": container with ID starting with a420689ae575766fe9122179ebf586aef2468e6efee74a21bd72d824c2bd9c3c not found: ID does not exist" Jul 23 19:11:08.886075 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.886021 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" podStartSLOduration=1.499392467 podStartE2EDuration="1.886004902s" totalImagesPullingTime="386.612435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:08.884149477 +0000 UTC m=+596.308147669" watchObservedRunningTime="2026-07-23 19:11:08.886004902 +0000 UTC m=+596.310003093" Jul 23 19:11:08.900761 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.900724 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56649d9c47-vx7nf"] Jul 23 19:11:08.903688 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.903657 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56649d9c47-vx7nf"] Jul 23 19:11:08.915455 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.915424 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkstg"] Jul 23 19:11:08.915654 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.915618 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zkstg" podUID="84853fd3-20e7-490f-8f4b-cbe0174fd631" containerName="authorino" containerID="cri-o://a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e" gracePeriod=30 Jul 23 19:11:08.923360 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.923327 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vlwwt"] Jul 23 19:11:08.931480 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:08.931433 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vlwwt"] Jul 23 19:11:09.080138 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.080099 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19dda885-2c62-4c3e-a1e0-f86143fb968a" path="/var/lib/kubelet/pods/19dda885-2c62-4c3e-a1e0-f86143fb968a/volumes" Jul 23 19:11:09.080677 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.080653 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c066926-ade0-46b4-aed4-4ed8be95f491" path="/var/lib/kubelet/pods/8c066926-ade0-46b4-aed4-4ed8be95f491/volumes" Jul 23 19:11:09.171245 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.171195 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:11:09.333924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.333886 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6pl9\" (UniqueName: \"kubernetes.io/projected/84853fd3-20e7-490f-8f4b-cbe0174fd631-kube-api-access-m6pl9\") pod \"84853fd3-20e7-490f-8f4b-cbe0174fd631\" (UID: \"84853fd3-20e7-490f-8f4b-cbe0174fd631\") " Jul 23 19:11:09.336013 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.335990 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84853fd3-20e7-490f-8f4b-cbe0174fd631-kube-api-access-m6pl9" (OuterVolumeSpecName: "kube-api-access-m6pl9") pod "84853fd3-20e7-490f-8f4b-cbe0174fd631" (UID: "84853fd3-20e7-490f-8f4b-cbe0174fd631"). InnerVolumeSpecName "kube-api-access-m6pl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:11:09.434651 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.434619 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6pl9\" (UniqueName: \"kubernetes.io/projected/84853fd3-20e7-490f-8f4b-cbe0174fd631-kube-api-access-m6pl9\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:11:09.870821 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.870733 2569 generic.go:356] "Generic (PLEG): container finished" podID="84853fd3-20e7-490f-8f4b-cbe0174fd631" containerID="a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e" exitCode=0 Jul 23 19:11:09.870821 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.870775 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkstg" Jul 23 19:11:09.871023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.870821 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkstg" event={"ID":"84853fd3-20e7-490f-8f4b-cbe0174fd631","Type":"ContainerDied","Data":"a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e"} Jul 23 19:11:09.871023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.870867 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkstg" event={"ID":"84853fd3-20e7-490f-8f4b-cbe0174fd631","Type":"ContainerDied","Data":"65f0d2db5f40c68d5ff52e0812049847989bb9998c7a20942d1c5fd1c8f8ae82"} Jul 23 19:11:09.871023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.870893 2569 scope.go:117] "RemoveContainer" containerID="a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e" Jul 23 19:11:09.879745 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.879726 2569 scope.go:117] "RemoveContainer" containerID="a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e" Jul 23 19:11:09.880053 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:09.880033 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e\": container with ID starting with a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e not found: ID does not exist" containerID="a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e" Jul 23 19:11:09.880105 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.880062 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e"} err="failed to get container status \"a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e\": rpc error: code = NotFound desc = could not find container \"a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e\": container with ID starting with a35b760bfeac7bc707b6358376dea4b4aa48bcd0619df634db54f5aa39ca3d0e not found: ID does not exist" Jul 23 19:11:09.891474 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.891449 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkstg"] Jul 23 19:11:09.897319 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:09.897292 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkstg"] Jul 23 19:11:11.080337 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:11.080304 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84853fd3-20e7-490f-8f4b-cbe0174fd631" path="/var/lib/kubelet/pods/84853fd3-20e7-490f-8f4b-cbe0174fd631/volumes" Jul 23 19:11:13.679941 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.679904 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f7b66bd-jcvtn"] Jul 23 19:11:13.685432 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.681121 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84853fd3-20e7-490f-8f4b-cbe0174fd631" containerName="authorino" Jul 23 19:11:13.685592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685468 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="84853fd3-20e7-490f-8f4b-cbe0174fd631" containerName="authorino" Jul 23 19:11:13.685592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685521 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19dda885-2c62-4c3e-a1e0-f86143fb968a" containerName="authorino" Jul 23 19:11:13.685592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685530 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="19dda885-2c62-4c3e-a1e0-f86143fb968a" containerName="authorino" Jul 23 19:11:13.685592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685545 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c066926-ade0-46b4-aed4-4ed8be95f491" containerName="authorino" Jul 23 19:11:13.685592 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685554 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c066926-ade0-46b4-aed4-4ed8be95f491" containerName="authorino" Jul 23 19:11:13.685822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685766 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c066926-ade0-46b4-aed4-4ed8be95f491" containerName="authorino" Jul 23 19:11:13.685822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685784 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="84853fd3-20e7-490f-8f4b-cbe0174fd631" containerName="authorino" Jul 23 19:11:13.685822 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.685802 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="19dda885-2c62-4c3e-a1e0-f86143fb968a" containerName="authorino" Jul 23 19:11:13.692919 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.692889 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:13.693164 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.693135 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f7b66bd-jcvtn"] Jul 23 19:11:13.695700 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.695665 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 19:11:13.695820 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.695664 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 19:11:13.695820 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.695772 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d5grv\"" Jul 23 19:11:13.778582 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.778540 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j4nf\" (UniqueName: \"kubernetes.io/projected/83974d01-9154-4ee8-81a3-f4e84e0a13c3-kube-api-access-2j4nf\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:13.778779 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.778695 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:13.842650 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.842611 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-867878f755-bz66t"] Jul 23 19:11:13.845800 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.845780 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:13.858434 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.858409 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867878f755-bz66t"] Jul 23 19:11:13.879725 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.879692 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:13.879877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.879738 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j4nf\" (UniqueName: \"kubernetes.io/projected/83974d01-9154-4ee8-81a3-f4e84e0a13c3-kube-api-access-2j4nf\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:13.879877 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:13.879849 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 23 19:11:13.879946 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:13.879917 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert podName:83974d01-9154-4ee8-81a3-f4e84e0a13c3 nodeName:}" failed. No retries permitted until 2026-07-23 19:11:14.379899241 +0000 UTC m=+601.803897414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert") pod "maas-controller-577f7b66bd-jcvtn" (UID: "83974d01-9154-4ee8-81a3-f4e84e0a13c3") : secret "maas-controller-webhook-cert" not found Jul 23 19:11:13.888624 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.888591 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j4nf\" (UniqueName: \"kubernetes.io/projected/83974d01-9154-4ee8-81a3-f4e84e0a13c3-kube-api-access-2j4nf\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:13.981080 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.981039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5t6s\" (UniqueName: \"kubernetes.io/projected/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-kube-api-access-l5t6s\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:13.981289 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:13.981099 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.081749 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.081689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5t6s\" (UniqueName: \"kubernetes.io/projected/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-kube-api-access-l5t6s\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.081957 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.081761 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.081957 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:14.081917 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 23 19:11:14.082105 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:14.082001 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert podName:2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f nodeName:}" failed. No retries permitted until 2026-07-23 19:11:14.581980255 +0000 UTC m=+602.005978437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert") pod "maas-controller-867878f755-bz66t" (UID: "2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f") : secret "maas-controller-webhook-cert" not found Jul 23 19:11:14.090918 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.090891 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5t6s\" (UniqueName: \"kubernetes.io/projected/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-kube-api-access-l5t6s\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.384661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.384547 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:14.387090 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.387064 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert\") pod \"maas-controller-577f7b66bd-jcvtn\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:14.587076 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.587018 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.589459 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.589430 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert\") pod \"maas-controller-867878f755-bz66t\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.603504 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.603479 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:14.737760 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.737732 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f7b66bd-jcvtn"] Jul 23 19:11:14.739330 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:14.739302 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83974d01_9154_4ee8_81a3_f4e84e0a13c3.slice/crio-f21a45839808dca11a3b66993e9ff21ca7e4280027b31e218460ac091c4d4b78 WatchSource:0}: Error finding container f21a45839808dca11a3b66993e9ff21ca7e4280027b31e218460ac091c4d4b78: Status 404 returned error can't find the container with id f21a45839808dca11a3b66993e9ff21ca7e4280027b31e218460ac091c4d4b78 Jul 23 19:11:14.755951 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.755928 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:14.890262 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.890214 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867878f755-bz66t"] Jul 23 19:11:14.892728 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:14.892701 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6fb1d6_98a3_451b_b9bb_d9cfbb01d53f.slice/crio-c32fde8b249d879d2e6c70024f9a5b13d54b13c920bfe0f83f7664bbf5893ee4 WatchSource:0}: Error finding container c32fde8b249d879d2e6c70024f9a5b13d54b13c920bfe0f83f7664bbf5893ee4: Status 404 returned error can't find the container with id c32fde8b249d879d2e6c70024f9a5b13d54b13c920bfe0f83f7664bbf5893ee4 Jul 23 19:11:14.898128 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:14.898101 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" event={"ID":"83974d01-9154-4ee8-81a3-f4e84e0a13c3","Type":"ContainerStarted","Data":"f21a45839808dca11a3b66993e9ff21ca7e4280027b31e218460ac091c4d4b78"} Jul 23 19:11:15.911979 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:15.911916 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bz66t" event={"ID":"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f","Type":"ContainerStarted","Data":"c32fde8b249d879d2e6c70024f9a5b13d54b13c920bfe0f83f7664bbf5893ee4"} Jul 23 19:11:17.924194 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:17.924149 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" event={"ID":"83974d01-9154-4ee8-81a3-f4e84e0a13c3","Type":"ContainerStarted","Data":"efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311"} Jul 23 19:11:17.924628 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:17.924274 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:17.925799 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:17.925774 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bz66t" event={"ID":"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f","Type":"ContainerStarted","Data":"fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33"} Jul 23 19:11:17.925917 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:17.925823 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:17.949616 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:17.949554 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" podStartSLOduration=2.401121761 podStartE2EDuration="4.949532379s" totalImagesPullingTime="2.548410618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:17.946509504 +0000 UTC m=+605.370507697" watchObservedRunningTime="2026-07-23 19:11:17.949532379 +0000 UTC m=+605.373530574" Jul 23 19:11:17.981162 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:17.981115 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-867878f755-bz66t" podStartSLOduration=2.579543724 podStartE2EDuration="4.981099307s" totalImagesPullingTime="2.401555583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:17.977113239 +0000 UTC m=+605.401111479" watchObservedRunningTime="2026-07-23 19:11:17.981099307 +0000 UTC m=+605.405097498" Jul 23 19:11:28.932529 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:28.932497 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:11:28.932919 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:28.932584 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:29.000187 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.000151 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f7b66bd-jcvtn"] Jul 23 19:11:29.000459 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.000416 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" podUID="83974d01-9154-4ee8-81a3-f4e84e0a13c3" containerName="manager" containerID="cri-o://efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311" gracePeriod=30 Jul 23 19:11:29.812832 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.812804 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:29.927192 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.927105 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j4nf\" (UniqueName: \"kubernetes.io/projected/83974d01-9154-4ee8-81a3-f4e84e0a13c3-kube-api-access-2j4nf\") pod \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " Jul 23 19:11:29.927192 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.927152 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert\") pod \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\" (UID: \"83974d01-9154-4ee8-81a3-f4e84e0a13c3\") " Jul 23 19:11:29.929310 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.929282 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "83974d01-9154-4ee8-81a3-f4e84e0a13c3" (UID: "83974d01-9154-4ee8-81a3-f4e84e0a13c3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:11:29.929430 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.929338 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83974d01-9154-4ee8-81a3-f4e84e0a13c3-kube-api-access-2j4nf" (OuterVolumeSpecName: "kube-api-access-2j4nf") pod "83974d01-9154-4ee8-81a3-f4e84e0a13c3" (UID: "83974d01-9154-4ee8-81a3-f4e84e0a13c3"). InnerVolumeSpecName "kube-api-access-2j4nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:11:29.985125 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.985088 2569 generic.go:356] "Generic (PLEG): container finished" podID="83974d01-9154-4ee8-81a3-f4e84e0a13c3" containerID="efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311" exitCode=0 Jul 23 19:11:29.985590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.985133 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" Jul 23 19:11:29.985590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.985135 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" event={"ID":"83974d01-9154-4ee8-81a3-f4e84e0a13c3","Type":"ContainerDied","Data":"efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311"} Jul 23 19:11:29.985590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.985194 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f7b66bd-jcvtn" event={"ID":"83974d01-9154-4ee8-81a3-f4e84e0a13c3","Type":"ContainerDied","Data":"f21a45839808dca11a3b66993e9ff21ca7e4280027b31e218460ac091c4d4b78"} Jul 23 19:11:29.985590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.985217 2569 scope.go:117] "RemoveContainer" containerID="efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311" Jul 23 19:11:29.994021 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.994005 2569 scope.go:117] "RemoveContainer" containerID="efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311" Jul 23 19:11:29.994276 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:11:29.994256 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311\": container with ID starting with efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311 not found: ID does not exist" containerID="efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311" Jul 23 19:11:29.994320 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:29.994286 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311"} err="failed to get container status \"efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311\": rpc error: code = NotFound desc = could not find container \"efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311\": container with ID starting with efe4530a68af31c56a9f358d271cbb93765875d59f253fe0faefa8bec62d0311 not found: ID does not exist" Jul 23 19:11:30.006642 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:30.006617 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f7b66bd-jcvtn"] Jul 23 19:11:30.011016 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:30.010989 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f7b66bd-jcvtn"] Jul 23 19:11:30.028460 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:30.028436 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j4nf\" (UniqueName: \"kubernetes.io/projected/83974d01-9154-4ee8-81a3-f4e84e0a13c3-kube-api-access-2j4nf\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:11:30.028460 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:30.028458 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83974d01-9154-4ee8-81a3-f4e84e0a13c3-webhook-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:11:31.079801 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:31.079766 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83974d01-9154-4ee8-81a3-f4e84e0a13c3" path="/var/lib/kubelet/pods/83974d01-9154-4ee8-81a3-f4e84e0a13c3/volumes" Jul 23 19:11:50.383819 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.383784 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p"] Jul 23 19:11:50.384291 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.384155 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83974d01-9154-4ee8-81a3-f4e84e0a13c3" containerName="manager" Jul 23 19:11:50.384291 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.384166 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="83974d01-9154-4ee8-81a3-f4e84e0a13c3" containerName="manager" Jul 23 19:11:50.384291 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.384254 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="83974d01-9154-4ee8-81a3-f4e84e0a13c3" containerName="manager" Jul 23 19:11:50.387467 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.387445 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.389873 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.389833 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 23 19:11:50.389989 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.389946 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jn4k8\"" Jul 23 19:11:50.402326 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.402303 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p"] Jul 23 19:11:50.526268 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.526207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b944b580-aad6-4dc9-825d-cb45e963684d-maas-api-tls\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.526268 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.526261 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbld5\" (UniqueName: \"kubernetes.io/projected/b944b580-aad6-4dc9-825d-cb45e963684d-kube-api-access-vbld5\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.526509 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.526404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b944b580-aad6-4dc9-825d-cb45e963684d-openshift-service-ca\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.627463 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.627426 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b944b580-aad6-4dc9-825d-cb45e963684d-openshift-service-ca\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.627643 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.627505 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b944b580-aad6-4dc9-825d-cb45e963684d-maas-api-tls\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.627643 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.627522 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbld5\" (UniqueName: \"kubernetes.io/projected/b944b580-aad6-4dc9-825d-cb45e963684d-kube-api-access-vbld5\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.628069 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.628046 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b944b580-aad6-4dc9-825d-cb45e963684d-openshift-service-ca\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.630127 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.630101 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b944b580-aad6-4dc9-825d-cb45e963684d-maas-api-tls\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.642332 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.642278 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbld5\" (UniqueName: \"kubernetes.io/projected/b944b580-aad6-4dc9-825d-cb45e963684d-kube-api-access-vbld5\") pod \"maas-api-7fc9b4c8bc-7xd8p\" (UID: \"b944b580-aad6-4dc9-825d-cb45e963684d\") " pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.697202 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.697172 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:50.846414 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:50.846382 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p"] Jul 23 19:11:50.848561 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:50.848501 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb944b580_aad6_4dc9_825d_cb45e963684d.slice/crio-1a7671c828358072577db8d2b8497442b4414b3e7c83694be9fd7a698d593475 WatchSource:0}: Error finding container 1a7671c828358072577db8d2b8497442b4414b3e7c83694be9fd7a698d593475: Status 404 returned error can't find the container with id 1a7671c828358072577db8d2b8497442b4414b3e7c83694be9fd7a698d593475 Jul 23 19:11:51.091523 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.091484 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" event={"ID":"b944b580-aad6-4dc9-825d-cb45e963684d","Type":"ContainerStarted","Data":"1a7671c828358072577db8d2b8497442b4414b3e7c83694be9fd7a698d593475"} Jul 23 19:11:51.156784 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.156743 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-h6q9h"] Jul 23 19:11:51.164732 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.164712 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.169282 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.169257 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 23 19:11:51.169384 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.169335 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nngq8\"" Jul 23 19:11:51.178567 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.178544 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-h6q9h"] Jul 23 19:11:51.192081 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.192054 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-swjqj"] Jul 23 19:11:51.195717 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.195699 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.211336 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.211313 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-swjqj"] Jul 23 19:11:51.334915 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.334884 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjstg\" (UniqueName: \"kubernetes.io/projected/1e70a898-f17e-40b6-a2ce-a0aaa6dafc01-kube-api-access-pjstg\") pod \"payload-pre-processing-7677b774bb-swjqj\" (UID: \"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.335102 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.334924 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2g2k\" (UniqueName: \"kubernetes.io/projected/4bd6ea21-370b-4b7d-be4c-38e20943ad88-kube-api-access-f2g2k\") pod \"payload-processing-5bf47cd988-h6q9h\" (UID: \"4bd6ea21-370b-4b7d-be4c-38e20943ad88\") " pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.335102 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.335023 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd6ea21-370b-4b7d-be4c-38e20943ad88-plugins-config-volume\") pod \"payload-processing-5bf47cd988-h6q9h\" (UID: \"4bd6ea21-370b-4b7d-be4c-38e20943ad88\") " pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.335102 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.335070 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70a898-f17e-40b6-a2ce-a0aaa6dafc01-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-swjqj\" (UID: \"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.435755 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.435722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd6ea21-370b-4b7d-be4c-38e20943ad88-plugins-config-volume\") pod \"payload-processing-5bf47cd988-h6q9h\" (UID: \"4bd6ea21-370b-4b7d-be4c-38e20943ad88\") " pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.436196 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.435768 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70a898-f17e-40b6-a2ce-a0aaa6dafc01-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-swjqj\" (UID: \"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.436196 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.435827 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjstg\" (UniqueName: \"kubernetes.io/projected/1e70a898-f17e-40b6-a2ce-a0aaa6dafc01-kube-api-access-pjstg\") pod \"payload-pre-processing-7677b774bb-swjqj\" (UID: \"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.436196 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.435851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2g2k\" (UniqueName: \"kubernetes.io/projected/4bd6ea21-370b-4b7d-be4c-38e20943ad88-kube-api-access-f2g2k\") pod \"payload-processing-5bf47cd988-h6q9h\" (UID: \"4bd6ea21-370b-4b7d-be4c-38e20943ad88\") " pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.436527 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.436502 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd6ea21-370b-4b7d-be4c-38e20943ad88-plugins-config-volume\") pod \"payload-processing-5bf47cd988-h6q9h\" (UID: \"4bd6ea21-370b-4b7d-be4c-38e20943ad88\") " pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.436703 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.436680 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e70a898-f17e-40b6-a2ce-a0aaa6dafc01-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-swjqj\" (UID: \"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.456294 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.456262 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2g2k\" (UniqueName: \"kubernetes.io/projected/4bd6ea21-370b-4b7d-be4c-38e20943ad88-kube-api-access-f2g2k\") pod \"payload-processing-5bf47cd988-h6q9h\" (UID: \"4bd6ea21-370b-4b7d-be4c-38e20943ad88\") " pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.456389 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.456337 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjstg\" (UniqueName: \"kubernetes.io/projected/1e70a898-f17e-40b6-a2ce-a0aaa6dafc01-kube-api-access-pjstg\") pod \"payload-pre-processing-7677b774bb-swjqj\" (UID: \"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.475785 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.475763 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:51.505997 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.505973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:51.654624 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.654589 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-h6q9h"] Jul 23 19:11:51.656569 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:51.656547 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd6ea21_370b_4b7d_be4c_38e20943ad88.slice/crio-2edf53806f5df77ee49e946f39d411e3926d0029f02be30aeca21541f34e4a28 WatchSource:0}: Error finding container 2edf53806f5df77ee49e946f39d411e3926d0029f02be30aeca21541f34e4a28: Status 404 returned error can't find the container with id 2edf53806f5df77ee49e946f39d411e3926d0029f02be30aeca21541f34e4a28 Jul 23 19:11:51.671106 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:51.671083 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-swjqj"] Jul 23 19:11:51.672538 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:11:51.672516 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e70a898_f17e_40b6_a2ce_a0aaa6dafc01.slice/crio-dcf2ec9d8ed38b37e6cc80cadb5bc21586209c55d701aa8322f7f8be347d0dac WatchSource:0}: Error finding container dcf2ec9d8ed38b37e6cc80cadb5bc21586209c55d701aa8322f7f8be347d0dac: Status 404 returned error can't find the container with id dcf2ec9d8ed38b37e6cc80cadb5bc21586209c55d701aa8322f7f8be347d0dac Jul 23 19:11:52.098562 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:52.098526 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" event={"ID":"4bd6ea21-370b-4b7d-be4c-38e20943ad88","Type":"ContainerStarted","Data":"2edf53806f5df77ee49e946f39d411e3926d0029f02be30aeca21541f34e4a28"} Jul 23 19:11:52.099653 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:52.099627 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" event={"ID":"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01","Type":"ContainerStarted","Data":"dcf2ec9d8ed38b37e6cc80cadb5bc21586209c55d701aa8322f7f8be347d0dac"} Jul 23 19:11:54.114183 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.114097 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" event={"ID":"4bd6ea21-370b-4b7d-be4c-38e20943ad88","Type":"ContainerStarted","Data":"5e9d97a833d40a845d7193f9ac92b0bec8a0917367af8c0e48404ccf217eb392"} Jul 23 19:11:54.114634 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.114212 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:11:54.115736 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.115711 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" event={"ID":"1e70a898-f17e-40b6-a2ce-a0aaa6dafc01","Type":"ContainerStarted","Data":"d757ff56b0c10253c4b7085c933b8a76b3699da1fc0ff08cc093119a63b5b8ee"} Jul 23 19:11:54.115839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.115778 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:11:54.117142 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.117118 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" event={"ID":"b944b580-aad6-4dc9-825d-cb45e963684d","Type":"ContainerStarted","Data":"ff9538ecd8a9e4450c513ab87d147d0c2a0cfc0895fb59ee5c6667630a981518"} Jul 23 19:11:54.117260 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.117212 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:11:54.132283 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.132216 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" podStartSLOduration=1.014439822 podStartE2EDuration="3.132201663s" totalImagesPullingTime="2.117761841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:54.13108711 +0000 UTC m=+641.555085303" watchObservedRunningTime="2026-07-23 19:11:54.132201663 +0000 UTC m=+641.556199857" Jul 23 19:11:54.151759 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.151707 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" podStartSLOduration=1.294752537 podStartE2EDuration="4.151691628s" totalImagesPullingTime="2.856939091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:54.150200292 +0000 UTC m=+641.574198498" watchObservedRunningTime="2026-07-23 19:11:54.151691628 +0000 UTC m=+641.575689819" Jul 23 19:11:54.170054 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:11:54.169994 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" podStartSLOduration=1.056775121 podStartE2EDuration="3.169975091s" totalImagesPullingTime="2.11319997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:11:54.168436606 +0000 UTC m=+641.592434798" watchObservedRunningTime="2026-07-23 19:11:54.169975091 +0000 UTC m=+641.593973288" Jul 23 19:12:00.127120 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:00.127089 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7fc9b4c8bc-7xd8p" Jul 23 19:12:05.124487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:05.124443 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" podUID="1e70a898-f17e-40b6-a2ce-a0aaa6dafc01" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.43:9004: connect: connection refused" Jul 23 19:12:05.124889 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:05.124827 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-h6q9h" Jul 23 19:12:15.123758 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:15.123725 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-swjqj" Jul 23 19:12:37.469894 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.469859 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt"] Jul 23 19:12:37.473499 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.473476 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.476495 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.476470 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 19:12:37.476616 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.476564 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 19:12:37.476675 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.476651 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g5frh\"" Jul 23 19:12:37.476744 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.476731 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 23 19:12:37.483926 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.483905 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt"] Jul 23 19:12:37.569728 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.569680 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.569926 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.569737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7bzj\" (UniqueName: \"kubernetes.io/projected/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-kube-api-access-r7bzj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.569926 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.569787 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.569926 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.569899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.570065 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.569928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.570065 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.569953 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671332 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671128 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671332 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671156 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671332 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671502 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671362 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7bzj\" (UniqueName: \"kubernetes.io/projected/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-kube-api-access-r7bzj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671502 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671421 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671587 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671528 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671682 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671663 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.671738 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.671680 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.673525 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.673501 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.673753 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.673735 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.679687 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.679664 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7bzj\" (UniqueName: \"kubernetes.io/projected/a4b30fc5-ef41-411b-85c5-bd4af1e762b3-kube-api-access-r7bzj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6trgt\" (UID: \"a4b30fc5-ef41-411b-85c5-bd4af1e762b3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.784680 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.784591 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:37.920179 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.920151 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt"] Jul 23 19:12:37.922303 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:12:37.922275 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b30fc5_ef41_411b_85c5_bd4af1e762b3.slice/crio-4a4a655f825592d368d424ca291d9f1bbb21a83e31d099aa310518e7067be627 WatchSource:0}: Error finding container 4a4a655f825592d368d424ca291d9f1bbb21a83e31d099aa310518e7067be627: Status 404 returned error can't find the container with id 4a4a655f825592d368d424ca291d9f1bbb21a83e31d099aa310518e7067be627 Jul 23 19:12:37.923838 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:37.923815 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 19:12:38.332771 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:38.332730 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" event={"ID":"a4b30fc5-ef41-411b-85c5-bd4af1e762b3","Type":"ContainerStarted","Data":"4a4a655f825592d368d424ca291d9f1bbb21a83e31d099aa310518e7067be627"} Jul 23 19:12:39.340121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:39.340027 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" event={"ID":"a4b30fc5-ef41-411b-85c5-bd4af1e762b3","Type":"ContainerStarted","Data":"cefbe692f0ae4900b7b4d9edf0ee9a32940aa58718bfdcda0ecd15502b7504a5"} Jul 23 19:12:39.360444 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:39.360383 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" podStartSLOduration=1.270720252 podStartE2EDuration="2.360363084s" totalImagesPullingTime="1.089642832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:12:39.359268868 +0000 UTC m=+686.783267061" watchObservedRunningTime="2026-07-23 19:12:39.360363084 +0000 UTC m=+686.784361275" Jul 23 19:12:47.785547 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:47.785511 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:47.785991 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:47.785610 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:47.798070 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:47.798047 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:48.394945 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:48.394914 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6trgt" Jul 23 19:12:56.623844 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.623803 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl"] Jul 23 19:12:56.628793 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.628770 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.634747 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.634721 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 23 19:12:56.653849 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.653822 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl"] Jul 23 19:12:56.759648 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.759617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.759796 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.759651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.759796 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.759676 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7cgn\" (UniqueName: \"kubernetes.io/projected/4c343ed8-78e0-4337-920a-0852c6b7626d-kube-api-access-g7cgn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.759796 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.759760 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.759893 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.759810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.759893 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.759875 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c343ed8-78e0-4337-920a-0852c6b7626d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.860689 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.860657 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.860689 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.860698 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cgn\" (UniqueName: \"kubernetes.io/projected/4c343ed8-78e0-4337-920a-0852c6b7626d-kube-api-access-g7cgn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.860944 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.860733 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.860944 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.860783 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.860944 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.860826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c343ed8-78e0-4337-920a-0852c6b7626d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.860944 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.860907 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.861155 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.861134 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.861214 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.861190 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.861324 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.861308 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.863041 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.863021 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c343ed8-78e0-4337-920a-0852c6b7626d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.863322 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.863304 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c343ed8-78e0-4337-920a-0852c6b7626d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.868794 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.868777 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cgn\" (UniqueName: \"kubernetes.io/projected/4c343ed8-78e0-4337-920a-0852c6b7626d-kube-api-access-g7cgn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl\" (UID: \"4c343ed8-78e0-4337-920a-0852c6b7626d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:56.939180 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:56.939150 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:12:57.070457 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:57.070432 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl"] Jul 23 19:12:57.072478 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:12:57.072448 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c343ed8_78e0_4337_920a_0852c6b7626d.slice/crio-8984319b256e3159ca876e1107b4a5710e19e662c0687c7d1e13383e67e60d69 WatchSource:0}: Error finding container 8984319b256e3159ca876e1107b4a5710e19e662c0687c7d1e13383e67e60d69: Status 404 returned error can't find the container with id 8984319b256e3159ca876e1107b4a5710e19e662c0687c7d1e13383e67e60d69 Jul 23 19:12:57.428280 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:57.428238 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" event={"ID":"4c343ed8-78e0-4337-920a-0852c6b7626d","Type":"ContainerStarted","Data":"39102f6cd94cdde72e87e2c4a8a446521fc92101108011ca9baf0ca54729e3ac"} Jul 23 19:12:57.428454 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:57.428312 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" event={"ID":"4c343ed8-78e0-4337-920a-0852c6b7626d","Type":"ContainerStarted","Data":"8984319b256e3159ca876e1107b4a5710e19e662c0687c7d1e13383e67e60d69"} Jul 23 19:12:57.448921 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:12:57.448874 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" podStartSLOduration=1.213160637 podStartE2EDuration="1.448858746s" totalImagesPullingTime="235.698109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:12:57.446933742 +0000 UTC m=+704.870931933" watchObservedRunningTime="2026-07-23 19:12:57.448858746 +0000 UTC m=+704.872856937" Jul 23 19:13:06.939359 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:13:06.939265 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:13:06.939359 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:13:06.939334 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:13:06.951734 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:13:06.951703 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:13:07.489355 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:13:07.489328 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl" Jul 23 19:14:17.081419 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.081393 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6796dbc5b6-mj9sb"] Jul 23 19:14:17.084796 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.084779 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.092063 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.092039 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6796dbc5b6-mj9sb"] Jul 23 19:14:17.243405 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.243364 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vpf8\" (UniqueName: \"kubernetes.io/projected/eb0732ab-92c1-4448-825c-332f78affc94-kube-api-access-6vpf8\") pod \"authorino-6796dbc5b6-mj9sb\" (UID: \"eb0732ab-92c1-4448-825c-332f78affc94\") " pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.243615 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.243494 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb0732ab-92c1-4448-825c-332f78affc94-tls-cert\") pod \"authorino-6796dbc5b6-mj9sb\" (UID: \"eb0732ab-92c1-4448-825c-332f78affc94\") " pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.344737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.344661 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpf8\" (UniqueName: \"kubernetes.io/projected/eb0732ab-92c1-4448-825c-332f78affc94-kube-api-access-6vpf8\") pod \"authorino-6796dbc5b6-mj9sb\" (UID: \"eb0732ab-92c1-4448-825c-332f78affc94\") " pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.344737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.344702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb0732ab-92c1-4448-825c-332f78affc94-tls-cert\") pod \"authorino-6796dbc5b6-mj9sb\" (UID: \"eb0732ab-92c1-4448-825c-332f78affc94\") " pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.347074 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.347054 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb0732ab-92c1-4448-825c-332f78affc94-tls-cert\") pod \"authorino-6796dbc5b6-mj9sb\" (UID: \"eb0732ab-92c1-4448-825c-332f78affc94\") " pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.352681 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.352654 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpf8\" (UniqueName: \"kubernetes.io/projected/eb0732ab-92c1-4448-825c-332f78affc94-kube-api-access-6vpf8\") pod \"authorino-6796dbc5b6-mj9sb\" (UID: \"eb0732ab-92c1-4448-825c-332f78affc94\") " pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.395306 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.395268 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" Jul 23 19:14:17.545881 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.545849 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6796dbc5b6-mj9sb"] Jul 23 19:14:17.548782 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:14:17.548758 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb0732ab_92c1_4448_825c_332f78affc94.slice/crio-edf966c6a8a4f0bf9d2cb4962c47457e9aea3280b86f96e3c73842781441845b WatchSource:0}: Error finding container edf966c6a8a4f0bf9d2cb4962c47457e9aea3280b86f96e3c73842781441845b: Status 404 returned error can't find the container with id edf966c6a8a4f0bf9d2cb4962c47457e9aea3280b86f96e3c73842781441845b Jul 23 19:14:17.834939 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:17.834904 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" event={"ID":"eb0732ab-92c1-4448-825c-332f78affc94","Type":"ContainerStarted","Data":"edf966c6a8a4f0bf9d2cb4962c47457e9aea3280b86f96e3c73842781441845b"} Jul 23 19:14:18.841745 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:18.841702 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" event={"ID":"eb0732ab-92c1-4448-825c-332f78affc94","Type":"ContainerStarted","Data":"c02392117100191b0594442aabc8d78ccc87708a651009552746fecc9d33fabb"} Jul 23 19:14:18.861331 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:18.861268 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6796dbc5b6-mj9sb" podStartSLOduration=1.432307937 podStartE2EDuration="1.861247741s" totalImagesPullingTime="428.939804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:14:18.860408509 +0000 UTC m=+786.284406693" watchObservedRunningTime="2026-07-23 19:14:18.861247741 +0000 UTC m=+786.285245933" Jul 23 19:14:18.897806 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:18.897767 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-667dc5cdb7-bnbz8"] Jul 23 19:14:18.898008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:18.897986 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" podUID="78b56c8e-d5b6-4b79-a891-3a2c12f1259f" containerName="authorino" containerID="cri-o://02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30" gracePeriod=30 Jul 23 19:14:19.152640 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.152604 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:14:19.269581 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.268488 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-tls-cert\") pod \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " Jul 23 19:14:19.269581 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.268585 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8z67\" (UniqueName: \"kubernetes.io/projected/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-kube-api-access-r8z67\") pod \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\" (UID: \"78b56c8e-d5b6-4b79-a891-3a2c12f1259f\") " Jul 23 19:14:19.273663 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.273620 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-kube-api-access-r8z67" (OuterVolumeSpecName: "kube-api-access-r8z67") pod "78b56c8e-d5b6-4b79-a891-3a2c12f1259f" (UID: "78b56c8e-d5b6-4b79-a891-3a2c12f1259f"). InnerVolumeSpecName "kube-api-access-r8z67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:14:19.298979 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.298906 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "78b56c8e-d5b6-4b79-a891-3a2c12f1259f" (UID: "78b56c8e-d5b6-4b79-a891-3a2c12f1259f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:14:19.369859 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.369827 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8z67\" (UniqueName: \"kubernetes.io/projected/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-kube-api-access-r8z67\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:14:19.369859 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.369856 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78b56c8e-d5b6-4b79-a891-3a2c12f1259f-tls-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:14:19.847772 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.847736 2569 generic.go:356] "Generic (PLEG): container finished" podID="78b56c8e-d5b6-4b79-a891-3a2c12f1259f" containerID="02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30" exitCode=0 Jul 23 19:14:19.848147 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.847782 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" Jul 23 19:14:19.848147 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.847830 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" event={"ID":"78b56c8e-d5b6-4b79-a891-3a2c12f1259f","Type":"ContainerDied","Data":"02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30"} Jul 23 19:14:19.848147 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.847871 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667dc5cdb7-bnbz8" event={"ID":"78b56c8e-d5b6-4b79-a891-3a2c12f1259f","Type":"ContainerDied","Data":"1b5d8a9e0d458e060fe0e11ec0a9ae1e8146c0662f75822fa4d94f938591e512"} Jul 23 19:14:19.848147 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.847890 2569 scope.go:117] "RemoveContainer" containerID="02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30" Jul 23 19:14:19.857490 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.857474 2569 scope.go:117] "RemoveContainer" containerID="02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30" Jul 23 19:14:19.857736 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:14:19.857717 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30\": container with ID starting with 02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30 not found: ID does not exist" containerID="02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30" Jul 23 19:14:19.857782 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.857746 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30"} err="failed to get container status \"02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30\": rpc error: code = NotFound desc = could not find container \"02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30\": container with ID starting with 02441353ce7d79ce70350fbd39fd80648a919703a836458eee8cade55d552a30 not found: ID does not exist" Jul 23 19:14:19.870023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.869999 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-667dc5cdb7-bnbz8"] Jul 23 19:14:19.876101 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:19.876074 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-667dc5cdb7-bnbz8"] Jul 23 19:14:21.079964 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:14:21.079931 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78b56c8e-d5b6-4b79-a891-3a2c12f1259f" path="/var/lib/kubelet/pods/78b56c8e-d5b6-4b79-a891-3a2c12f1259f/volumes" Jul 23 19:15:04.242988 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.242954 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867878f755-bz66t"] Jul 23 19:15:04.243572 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.243175 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-867878f755-bz66t" podUID="2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" containerName="manager" containerID="cri-o://fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33" gracePeriod=30 Jul 23 19:15:04.494478 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.494424 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:15:04.510180 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.510155 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5t6s\" (UniqueName: \"kubernetes.io/projected/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-kube-api-access-l5t6s\") pod \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " Jul 23 19:15:04.510397 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.510269 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert\") pod \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\" (UID: \"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f\") " Jul 23 19:15:04.512427 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.512399 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" (UID: "2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:15:04.513450 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.513425 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-kube-api-access-l5t6s" (OuterVolumeSpecName: "kube-api-access-l5t6s") pod "2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" (UID: "2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f"). InnerVolumeSpecName "kube-api-access-l5t6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:15:04.611132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.611085 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5t6s\" (UniqueName: \"kubernetes.io/projected/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-kube-api-access-l5t6s\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:15:04.611132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:04.611128 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f-webhook-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:15:05.079933 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.079899 2569 generic.go:356] "Generic (PLEG): container finished" podID="2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" containerID="fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33" exitCode=0 Jul 23 19:15:05.080107 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.079971 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bz66t" Jul 23 19:15:05.080623 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.080603 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bz66t" event={"ID":"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f","Type":"ContainerDied","Data":"fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33"} Jul 23 19:15:05.080710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.080646 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bz66t" event={"ID":"2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f","Type":"ContainerDied","Data":"c32fde8b249d879d2e6c70024f9a5b13d54b13c920bfe0f83f7664bbf5893ee4"} Jul 23 19:15:05.080710 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.080674 2569 scope.go:117] "RemoveContainer" containerID="fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33" Jul 23 19:15:05.092151 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.092127 2569 scope.go:117] "RemoveContainer" containerID="fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33" Jul 23 19:15:05.092534 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:15:05.092506 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33\": container with ID starting with fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33 not found: ID does not exist" containerID="fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33" Jul 23 19:15:05.092644 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.092545 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33"} err="failed to get container status \"fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33\": rpc error: code = NotFound desc = could not find container \"fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33\": container with ID starting with fdb4c9c5b228c0adb714162656251830d8fcae1a81b5844fd1430c5863347b33 not found: ID does not exist" Jul 23 19:15:05.113365 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.113333 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867878f755-bz66t"] Jul 23 19:15:05.115102 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:05.115082 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-867878f755-bz66t"] Jul 23 19:15:07.079863 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:15:07.079830 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" path="/var/lib/kubelet/pods/2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f/volumes" Jul 23 19:16:05.918058 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.917979 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-867878f755-bs2bf"] Jul 23 19:16:05.918579 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.918560 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b56c8e-d5b6-4b79-a891-3a2c12f1259f" containerName="authorino" Jul 23 19:16:05.918661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.918585 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b56c8e-d5b6-4b79-a891-3a2c12f1259f" containerName="authorino" Jul 23 19:16:05.918661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.918601 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" containerName="manager" Jul 23 19:16:05.918661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.918609 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" containerName="manager" Jul 23 19:16:05.918775 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.918738 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b56c8e-d5b6-4b79-a891-3a2c12f1259f" containerName="authorino" Jul 23 19:16:05.918775 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.918753 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e6fb1d6-98a3-451b-b9bb-d9cfbb01d53f" containerName="manager" Jul 23 19:16:05.922102 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.922083 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:05.925302 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.925283 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 19:16:05.925737 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.925708 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d5grv\"" Jul 23 19:16:05.925814 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.925747 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 19:16:05.939866 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.939840 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867878f755-bs2bf"] Jul 23 19:16:05.997854 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.997826 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/389c9b83-0458-4354-b919-2d947d322c73-webhook-cert\") pod \"maas-controller-867878f755-bs2bf\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:05.997977 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:05.997871 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q78hf\" (UniqueName: \"kubernetes.io/projected/389c9b83-0458-4354-b919-2d947d322c73-kube-api-access-q78hf\") pod \"maas-controller-867878f755-bs2bf\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:06.098629 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:06.098600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/389c9b83-0458-4354-b919-2d947d322c73-webhook-cert\") pod \"maas-controller-867878f755-bs2bf\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:06.098785 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:06.098639 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q78hf\" (UniqueName: \"kubernetes.io/projected/389c9b83-0458-4354-b919-2d947d322c73-kube-api-access-q78hf\") pod \"maas-controller-867878f755-bs2bf\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:06.100979 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:06.100955 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/389c9b83-0458-4354-b919-2d947d322c73-webhook-cert\") pod \"maas-controller-867878f755-bs2bf\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:06.108087 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:06.108052 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q78hf\" (UniqueName: \"kubernetes.io/projected/389c9b83-0458-4354-b919-2d947d322c73-kube-api-access-q78hf\") pod \"maas-controller-867878f755-bs2bf\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:06.256959 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:06.256925 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:06.603839 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:06.603811 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867878f755-bs2bf"] Jul 23 19:16:06.606071 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:16:06.606043 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389c9b83_0458_4354_b919_2d947d322c73.slice/crio-90d5e308105f4e0849de38216de8155c8a5c6b0e82228d303e21a550f39d244d WatchSource:0}: Error finding container 90d5e308105f4e0849de38216de8155c8a5c6b0e82228d303e21a550f39d244d: Status 404 returned error can't find the container with id 90d5e308105f4e0849de38216de8155c8a5c6b0e82228d303e21a550f39d244d Jul 23 19:16:07.379195 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:07.379104 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bs2bf" event={"ID":"389c9b83-0458-4354-b919-2d947d322c73","Type":"ContainerStarted","Data":"134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809"} Jul 23 19:16:07.379195 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:07.379154 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bs2bf" event={"ID":"389c9b83-0458-4354-b919-2d947d322c73","Type":"ContainerStarted","Data":"90d5e308105f4e0849de38216de8155c8a5c6b0e82228d303e21a550f39d244d"} Jul 23 19:16:07.379618 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:07.379249 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:07.397964 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:07.397918 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-867878f755-bs2bf" podStartSLOduration=1.9389854309999999 podStartE2EDuration="2.397901108s" totalImagesPullingTime="458.915677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:16:07.396629509 +0000 UTC m=+894.820627702" watchObservedRunningTime="2026-07-23 19:16:07.397901108 +0000 UTC m=+894.821899300" Jul 23 19:16:18.386530 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:18.386493 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:23.034041 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.033998 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867878f755-bs2bf"] Jul 23 19:16:23.034608 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.034244 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-867878f755-bs2bf" podUID="389c9b83-0458-4354-b919-2d947d322c73" containerName="manager" containerID="cri-o://134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809" gracePeriod=30 Jul 23 19:16:23.284008 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.283981 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:23.368258 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.368131 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q78hf\" (UniqueName: \"kubernetes.io/projected/389c9b83-0458-4354-b919-2d947d322c73-kube-api-access-q78hf\") pod \"389c9b83-0458-4354-b919-2d947d322c73\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " Jul 23 19:16:23.368258 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.368176 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/389c9b83-0458-4354-b919-2d947d322c73-webhook-cert\") pod \"389c9b83-0458-4354-b919-2d947d322c73\" (UID: \"389c9b83-0458-4354-b919-2d947d322c73\") " Jul 23 19:16:23.370276 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.370246 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/389c9b83-0458-4354-b919-2d947d322c73-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "389c9b83-0458-4354-b919-2d947d322c73" (UID: "389c9b83-0458-4354-b919-2d947d322c73"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 19:16:23.370365 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.370301 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/389c9b83-0458-4354-b919-2d947d322c73-kube-api-access-q78hf" (OuterVolumeSpecName: "kube-api-access-q78hf") pod "389c9b83-0458-4354-b919-2d947d322c73" (UID: "389c9b83-0458-4354-b919-2d947d322c73"). InnerVolumeSpecName "kube-api-access-q78hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 19:16:23.463623 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.463591 2569 generic.go:356] "Generic (PLEG): container finished" podID="389c9b83-0458-4354-b919-2d947d322c73" containerID="134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809" exitCode=0 Jul 23 19:16:23.463785 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.463639 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-bs2bf" Jul 23 19:16:23.463785 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.463674 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bs2bf" event={"ID":"389c9b83-0458-4354-b919-2d947d322c73","Type":"ContainerDied","Data":"134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809"} Jul 23 19:16:23.463785 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.463732 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-bs2bf" event={"ID":"389c9b83-0458-4354-b919-2d947d322c73","Type":"ContainerDied","Data":"90d5e308105f4e0849de38216de8155c8a5c6b0e82228d303e21a550f39d244d"} Jul 23 19:16:23.463785 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.463755 2569 scope.go:117] "RemoveContainer" containerID="134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809" Jul 23 19:16:23.469121 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.469099 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q78hf\" (UniqueName: \"kubernetes.io/projected/389c9b83-0458-4354-b919-2d947d322c73-kube-api-access-q78hf\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:16:23.469254 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.469124 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/389c9b83-0458-4354-b919-2d947d322c73-webhook-cert\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\"" Jul 23 19:16:23.473109 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.473089 2569 scope.go:117] "RemoveContainer" containerID="134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809" Jul 23 19:16:23.473397 ip-10-0-128-42 kubenswrapper[2569]: E0723 19:16:23.473377 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809\": container with ID starting with 134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809 not found: ID does not exist" containerID="134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809" Jul 23 19:16:23.473459 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.473405 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809"} err="failed to get container status \"134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809\": rpc error: code = NotFound desc = could not find container \"134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809\": container with ID starting with 134c65d30e6e1e4b01457f9d19d8019ac8238e98ea97554dd5f263117d29f809 not found: ID does not exist" Jul 23 19:16:23.485319 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.485293 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867878f755-bs2bf"] Jul 23 19:16:23.489892 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:23.489869 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-867878f755-bs2bf"] Jul 23 19:16:24.296134 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.296097 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-867878f755-cx2ns"] Jul 23 19:16:24.296773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.296754 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="389c9b83-0458-4354-b919-2d947d322c73" containerName="manager" Jul 23 19:16:24.296773 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.296773 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="389c9b83-0458-4354-b919-2d947d322c73" containerName="manager" Jul 23 19:16:24.296914 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.296839 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="389c9b83-0458-4354-b919-2d947d322c73" containerName="manager" Jul 23 19:16:24.301306 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.301279 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.304486 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.304465 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 19:16:24.304486 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.304492 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d5grv\"" Jul 23 19:16:24.304486 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.304500 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 19:16:24.309290 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.309267 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867878f755-cx2ns"] Jul 23 19:16:24.378651 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.378603 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dac81317-b139-42dc-8007-34bd6624d34e-webhook-cert\") pod \"maas-controller-867878f755-cx2ns\" (UID: \"dac81317-b139-42dc-8007-34bd6624d34e\") " pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.378837 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.378677 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64kdx\" (UniqueName: \"kubernetes.io/projected/dac81317-b139-42dc-8007-34bd6624d34e-kube-api-access-64kdx\") pod \"maas-controller-867878f755-cx2ns\" (UID: \"dac81317-b139-42dc-8007-34bd6624d34e\") " pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.479280 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.479208 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dac81317-b139-42dc-8007-34bd6624d34e-webhook-cert\") pod \"maas-controller-867878f755-cx2ns\" (UID: \"dac81317-b139-42dc-8007-34bd6624d34e\") " pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.479469 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.479330 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64kdx\" (UniqueName: \"kubernetes.io/projected/dac81317-b139-42dc-8007-34bd6624d34e-kube-api-access-64kdx\") pod \"maas-controller-867878f755-cx2ns\" (UID: \"dac81317-b139-42dc-8007-34bd6624d34e\") " pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.481698 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.481677 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dac81317-b139-42dc-8007-34bd6624d34e-webhook-cert\") pod \"maas-controller-867878f755-cx2ns\" (UID: \"dac81317-b139-42dc-8007-34bd6624d34e\") " pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.487288 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.487261 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64kdx\" (UniqueName: \"kubernetes.io/projected/dac81317-b139-42dc-8007-34bd6624d34e-kube-api-access-64kdx\") pod \"maas-controller-867878f755-cx2ns\" (UID: \"dac81317-b139-42dc-8007-34bd6624d34e\") " pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.613633 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.613540 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:24.750752 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:24.750726 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867878f755-cx2ns"] Jul 23 19:16:24.753045 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:16:24.753015 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac81317_b139_42dc_8007_34bd6624d34e.slice/crio-e23f4837cafc819dce2788fc1b1792afe40789500aab886f348fa85b0d3d5e8f WatchSource:0}: Error finding container e23f4837cafc819dce2788fc1b1792afe40789500aab886f348fa85b0d3d5e8f: Status 404 returned error can't find the container with id e23f4837cafc819dce2788fc1b1792afe40789500aab886f348fa85b0d3d5e8f Jul 23 19:16:25.079552 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:25.079519 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="389c9b83-0458-4354-b919-2d947d322c73" path="/var/lib/kubelet/pods/389c9b83-0458-4354-b919-2d947d322c73/volumes" Jul 23 19:16:25.477104 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:25.477070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-cx2ns" event={"ID":"dac81317-b139-42dc-8007-34bd6624d34e","Type":"ContainerStarted","Data":"f8543577fa89cc7a5af76ff9f1c85c43d0cf38701924a4d3904dea189ed99105"} Jul 23 19:16:25.477615 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:25.477126 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867878f755-cx2ns" event={"ID":"dac81317-b139-42dc-8007-34bd6624d34e","Type":"ContainerStarted","Data":"e23f4837cafc819dce2788fc1b1792afe40789500aab886f348fa85b0d3d5e8f"} Jul 23 19:16:25.477615 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:25.477157 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:16:25.496304 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:25.496254 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-867878f755-cx2ns" podStartSLOduration=1.042458078 podStartE2EDuration="1.496237985s" totalImagesPullingTime="453.779907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:16:25.494682291 +0000 UTC m=+912.918680484" watchObservedRunningTime="2026-07-23 19:16:25.496237985 +0000 UTC m=+912.920236168" Jul 23 19:16:36.484385 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:16:36.484350 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-867878f755-cx2ns" Jul 23 19:22:12.558721 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.558642 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb"] Jul 23 19:22:12.562023 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.562007 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.564438 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.564421 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-556q5\"" Jul 23 19:22:12.575917 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.575895 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb"] Jul 23 19:22:12.709922 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.709885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa41ad02-a369-47a5-86ab-1177338c45fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jdpwb\" (UID: \"aa41ad02-a369-47a5-86ab-1177338c45fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.710103 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.709933 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9m66\" (UniqueName: \"kubernetes.io/projected/aa41ad02-a369-47a5-86ab-1177338c45fe-kube-api-access-r9m66\") pod \"kuadrant-operator-controller-manager-86878c769f-jdpwb\" (UID: \"aa41ad02-a369-47a5-86ab-1177338c45fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.810976 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.810886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa41ad02-a369-47a5-86ab-1177338c45fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jdpwb\" (UID: \"aa41ad02-a369-47a5-86ab-1177338c45fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.810976 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.810936 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9m66\" (UniqueName: \"kubernetes.io/projected/aa41ad02-a369-47a5-86ab-1177338c45fe-kube-api-access-r9m66\") pod \"kuadrant-operator-controller-manager-86878c769f-jdpwb\" (UID: \"aa41ad02-a369-47a5-86ab-1177338c45fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.811290 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.811271 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa41ad02-a369-47a5-86ab-1177338c45fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jdpwb\" (UID: \"aa41ad02-a369-47a5-86ab-1177338c45fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.819944 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.819922 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9m66\" (UniqueName: \"kubernetes.io/projected/aa41ad02-a369-47a5-86ab-1177338c45fe-kube-api-access-r9m66\") pod \"kuadrant-operator-controller-manager-86878c769f-jdpwb\" (UID: \"aa41ad02-a369-47a5-86ab-1177338c45fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:12.872731 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:12.872699 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:13.010700 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:13.010674 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb"] Jul 23 19:22:13.013196 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:22:13.013169 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa41ad02_a369_47a5_86ab_1177338c45fe.slice/crio-6e397f59226071f07366efc1fc0c6202c67526d3aee966fb6c200968d8ef5fe4 WatchSource:0}: Error finding container 6e397f59226071f07366efc1fc0c6202c67526d3aee966fb6c200968d8ef5fe4: Status 404 returned error can't find the container with id 6e397f59226071f07366efc1fc0c6202c67526d3aee966fb6c200968d8ef5fe4 Jul 23 19:22:13.232109 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:13.232073 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" event={"ID":"aa41ad02-a369-47a5-86ab-1177338c45fe","Type":"ContainerStarted","Data":"64383e44bcca1987187b35bdc87b4839b6241c80ee2c5fbd1c4645b60356c19c"} Jul 23 19:22:13.232306 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:13.232125 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" event={"ID":"aa41ad02-a369-47a5-86ab-1177338c45fe","Type":"ContainerStarted","Data":"6e397f59226071f07366efc1fc0c6202c67526d3aee966fb6c200968d8ef5fe4"} Jul 23 19:22:13.232306 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:13.232162 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:22:13.255638 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:13.255567 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" podStartSLOduration=1.255551265 podStartE2EDuration="1.255551265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:22:13.252947577 +0000 UTC m=+1260.676945767" watchObservedRunningTime="2026-07-23 19:22:13.255551265 +0000 UTC m=+1260.679549456" Jul 23 19:22:24.238537 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:22:24.238500 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdpwb" Jul 23 19:47:54.097661 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:47:54.097627 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6796dbc5b6-mj9sb_eb0732ab-92c1-4448-825c-332f78affc94/authorino/0.log" Jul 23 19:47:59.401747 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:47:59.401714 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-867878f755-cx2ns_dac81317-b139-42dc-8007-34bd6624d34e/manager/0.log" Jul 23 19:47:59.759050 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:47:59.759019 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6657c8cb8d-4z6n2_4b6f5504-f23c-4d87-8689-ec4a0fd00899/copy-manifests/0.log" Jul 23 19:47:59.771303 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:47:59.771273 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6657c8cb8d-4z6n2_4b6f5504-f23c-4d87-8689-ec4a0fd00899/manager/0.log" Jul 23 19:48:00.375422 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:00.375392 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7fc9b4c8bc-7xd8p_b944b580-aad6-4dc9-825d-cb45e963684d/maas-api/0.log" Jul 23 19:48:00.815873 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:00.815840 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-78mcf_93b94b4f-f4dd-44f7-89a4-703de5824bd4/postgres/0.log" Jul 23 19:48:02.029970 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:02.029935 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6796dbc5b6-mj9sb_eb0732ab-92c1-4448-825c-332f78affc94/authorino/0.log" Jul 23 19:48:02.589626 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:02.589591 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jdpwb_aa41ad02-a369-47a5-86ab-1177338c45fe/manager/0.log" Jul 23 19:48:03.470643 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:03.470613 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b646958c-wtgh7_7fb94798-9ee9-40f9-807e-54bdfb309a2b/kube-auth-proxy/0.log" Jul 23 19:48:03.699963 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:03.699928 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-swjqj_1e70a898-f17e-40b6-a2ce-a0aaa6dafc01/payload-pre-processing/0.log" Jul 23 19:48:03.819674 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:03.819582 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h6q9h_4bd6ea21-370b-4b7d-be4c-38e20943ad88/payload-processing/0.log" Jul 23 19:48:04.483680 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:04.483653 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6trgt_a4b30fc5-ef41-411b-85c5-bd4af1e762b3/main/0.log" Jul 23 19:48:04.597960 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:04.597934 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwg5bl_4c343ed8-78e0-4337-920a-0852c6b7626d/main/0.log" Jul 23 19:48:13.288938 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:13.288907 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8p7m6_6d852daa-548b-42b9-a2ec-5a5003ac0cff/global-pull-secret-syncer/0.log" Jul 23 19:48:13.400823 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:13.400787 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-twdst_7e9e4424-1675-4d06-84dc-c92e423de55e/konnectivity-agent/0.log" Jul 23 19:48:13.455096 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:13.455067 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-42.ec2.internal_6afd729819b14aa08ff5546801a18817/haproxy/0.log" Jul 23 19:48:18.655939 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:18.655853 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6796dbc5b6-mj9sb_eb0732ab-92c1-4448-825c-332f78affc94/authorino/0.log" Jul 23 19:48:18.917910 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:18.917821 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jdpwb_aa41ad02-a369-47a5-86ab-1177338c45fe/manager/0.log" Jul 23 19:48:20.622755 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.622725 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/alertmanager/0.log" Jul 23 19:48:20.645566 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.645541 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/config-reloader/0.log" Jul 23 19:48:20.667134 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.667111 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/kube-rbac-proxy-web/0.log" Jul 23 19:48:20.691573 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.691552 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/kube-rbac-proxy/0.log" Jul 23 19:48:20.713058 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.713027 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/kube-rbac-proxy-metric/0.log" Jul 23 19:48:20.738328 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.738297 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/prom-label-proxy/0.log" Jul 23 19:48:20.760554 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.760526 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_994f9335-0d86-4f92-b26d-e4c4bf409036/init-config-reloader/0.log" Jul 23 19:48:20.837285 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.837256 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-9c5v8_925a85c3-606c-4005-99eb-e383dc2bac1f/kube-state-metrics/0.log" Jul 23 19:48:20.860354 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.860286 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-9c5v8_925a85c3-606c-4005-99eb-e383dc2bac1f/kube-rbac-proxy-main/0.log" Jul 23 19:48:20.882813 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.882786 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-9c5v8_925a85c3-606c-4005-99eb-e383dc2bac1f/kube-rbac-proxy-self/0.log" Jul 23 19:48:20.911269 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.911219 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8588757d9b-w9j6r_b260f67b-78e1-4476-b69e-d5ccf6fb833d/metrics-server/0.log" Jul 23 19:48:20.942665 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:20.942643 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-7jzqt_42d5b034-52d9-4f6d-b760-07fcf9bae93f/monitoring-plugin/0.log" Jul 23 19:48:21.056452 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.056424 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pnjsr_7d21cfbb-1349-45fa-8e1d-d2a360a10611/node-exporter/0.log" Jul 23 19:48:21.077911 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.077886 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pnjsr_7d21cfbb-1349-45fa-8e1d-d2a360a10611/kube-rbac-proxy/0.log" Jul 23 19:48:21.098381 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.098360 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pnjsr_7d21cfbb-1349-45fa-8e1d-d2a360a10611/init-textfile/0.log" Jul 23 19:48:21.200647 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.200613 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-99rwb_61ce1cb9-da85-4856-a021-6e7f9e523e8f/kube-rbac-proxy-main/0.log" Jul 23 19:48:21.224542 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.224513 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-99rwb_61ce1cb9-da85-4856-a021-6e7f9e523e8f/kube-rbac-proxy-self/0.log" Jul 23 19:48:21.245725 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.245692 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-99rwb_61ce1cb9-da85-4856-a021-6e7f9e523e8f/openshift-state-metrics/0.log" Jul 23 19:48:21.289148 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.289125 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/prometheus/0.log" Jul 23 19:48:21.309854 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.309831 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/config-reloader/0.log" Jul 23 19:48:21.333404 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.333382 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/thanos-sidecar/0.log" Jul 23 19:48:21.358651 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.358625 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/kube-rbac-proxy-web/0.log" Jul 23 19:48:21.383732 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.383712 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/kube-rbac-proxy/0.log" Jul 23 19:48:21.410664 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.410645 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/kube-rbac-proxy-thanos/0.log" Jul 23 19:48:21.433151 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.433131 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85e3be41-a0e6-49e7-8ac0-e59cad4785cc/init-config-reloader/0.log" Jul 23 19:48:21.461025 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.460958 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fbtnd_d781789b-f050-4b85-a4fb-1dbaa8c5cd76/prometheus-operator/0.log" Jul 23 19:48:21.481486 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.481467 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fbtnd_d781789b-f050-4b85-a4fb-1dbaa8c5cd76/kube-rbac-proxy/0.log" Jul 23 19:48:21.505257 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.505216 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-rlgsc_a83d0b49-ea2a-4284-8aac-8c95560d6a1f/prometheus-operator-admission-webhook/0.log" Jul 23 19:48:21.534268 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.534243 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dc8545fb9-4zvmf_437b47ef-b869-4383-82b6-8a6297c1bc47/telemeter-client/0.log" Jul 23 19:48:21.556109 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.556087 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dc8545fb9-4zvmf_437b47ef-b869-4383-82b6-8a6297c1bc47/reload/0.log" Jul 23 19:48:21.578057 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.578037 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dc8545fb9-4zvmf_437b47ef-b869-4383-82b6-8a6297c1bc47/kube-rbac-proxy/0.log" Jul 23 19:48:21.620541 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.620524 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597c4f44-xmxk4_2b85c0c1-cc70-4b50-88f0-7104f3c2d88a/thanos-query/0.log" Jul 23 19:48:21.640796 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.640773 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597c4f44-xmxk4_2b85c0c1-cc70-4b50-88f0-7104f3c2d88a/kube-rbac-proxy-web/0.log" Jul 23 19:48:21.663734 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.663714 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597c4f44-xmxk4_2b85c0c1-cc70-4b50-88f0-7104f3c2d88a/kube-rbac-proxy/0.log" Jul 23 19:48:21.683927 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.683908 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597c4f44-xmxk4_2b85c0c1-cc70-4b50-88f0-7104f3c2d88a/prom-label-proxy/0.log" Jul 23 19:48:21.704207 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.704189 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597c4f44-xmxk4_2b85c0c1-cc70-4b50-88f0-7104f3c2d88a/kube-rbac-proxy-rules/0.log" Jul 23 19:48:21.724459 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:21.724399 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56597c4f44-xmxk4_2b85c0c1-cc70-4b50-88f0-7104f3c2d88a/kube-rbac-proxy-metrics/0.log" Jul 23 19:48:23.358315 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.358273 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q"] Jul 23 19:48:23.362218 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.362192 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.364818 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.364793 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ctxw\"/\"kube-root-ca.crt\"" Jul 23 19:48:23.365523 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.365499 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5ctxw\"/\"default-dockercfg-vxjpx\"" Jul 23 19:48:23.365647 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.365551 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ctxw\"/\"openshift-service-ca.crt\"" Jul 23 19:48:23.368546 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.368522 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q"] Jul 23 19:48:23.491721 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.491681 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-proc\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.491721 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.491722 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-lib-modules\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.491933 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.491749 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-podres\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.491933 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.491871 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-sys\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.491933 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.491916 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qbrt\" (UniqueName: \"kubernetes.io/projected/f6aba4f0-a23f-4e50-9d59-f19569f49850-kube-api-access-5qbrt\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593464 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593430 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-sys\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593480 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qbrt\" (UniqueName: \"kubernetes.io/projected/f6aba4f0-a23f-4e50-9d59-f19569f49850-kube-api-access-5qbrt\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-proc\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593568 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-lib-modules\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593570 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-sys\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-podres\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593649 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593636 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-proc\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-lib-modules\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.593877 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.593747 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6aba4f0-a23f-4e50-9d59-f19569f49850-podres\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.601254 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.601217 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qbrt\" (UniqueName: \"kubernetes.io/projected/f6aba4f0-a23f-4e50-9d59-f19569f49850-kube-api-access-5qbrt\") pod \"perf-node-gather-daemonset-zkp7q\" (UID: \"f6aba4f0-a23f-4e50-9d59-f19569f49850\") " pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.674272 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.674150 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:23.808424 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:23.808387 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q"] Jul 23 19:48:23.811461 ip-10-0-128-42 kubenswrapper[2569]: W0723 19:48:23.811436 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6aba4f0_a23f_4e50_9d59_f19569f49850.slice/crio-18c60f3b75ee21e7af725f141b4df46145880e3414f9ea848f8889e9495ad5a6 WatchSource:0}: Error finding container 18c60f3b75ee21e7af725f141b4df46145880e3414f9ea848f8889e9495ad5a6: Status 404 returned error can't find the container with id 18c60f3b75ee21e7af725f141b4df46145880e3414f9ea848f8889e9495ad5a6 Jul 23 19:48:24.139389 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:24.139359 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5748bcc894-9lnn4_2031b2f7-3245-4181-9a8d-ee6db3d19fea/console/0.log" Jul 23 19:48:24.172509 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:24.172467 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" event={"ID":"f6aba4f0-a23f-4e50-9d59-f19569f49850","Type":"ContainerStarted","Data":"ba73d982dbcccbd0cbb66574ab9e848aceee670fadd0c5e55b5c6d3fe60e1a6e"} Jul 23 19:48:24.172968 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:24.172537 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" event={"ID":"f6aba4f0-a23f-4e50-9d59-f19569f49850","Type":"ContainerStarted","Data":"18c60f3b75ee21e7af725f141b4df46145880e3414f9ea848f8889e9495ad5a6"} Jul 23 19:48:24.172968 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:24.172595 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:24.188085 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:24.188042 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" podStartSLOduration=1.188026982 podStartE2EDuration="1.188026982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:48:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:48:24.187638144 +0000 UTC m=+2831.611636337" watchObservedRunningTime="2026-07-23 19:48:24.188026982 +0000 UTC m=+2831.612025206" Jul 23 19:48:25.759285 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:25.759246 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cs9kh_7fbae762-dc10-43e9-88ad-f2ee75af2c67/dns/0.log" Jul 23 19:48:25.782833 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:25.782809 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cs9kh_7fbae762-dc10-43e9-88ad-f2ee75af2c67/kube-rbac-proxy/0.log" Jul 23 19:48:25.928549 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:25.928514 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6msx_b84dcda5-aaa4-44e6-b5bc-7c4c80d4b095/dns-node-resolver/0.log" Jul 23 19:48:26.519138 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:26.519105 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cjn4_a435ed1a-6236-422a-a2a8-ed4a5997cbe2/node-ca/0.log" Jul 23 19:48:27.676202 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:27.676174 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b646958c-wtgh7_7fb94798-9ee9-40f9-807e-54bdfb309a2b/kube-auth-proxy/0.log" Jul 23 19:48:27.760924 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:27.760890 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-swjqj_1e70a898-f17e-40b6-a2ce-a0aaa6dafc01/payload-pre-processing/0.log" Jul 23 19:48:27.791056 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:27.791030 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h6q9h_4bd6ea21-370b-4b7d-be4c-38e20943ad88/payload-processing/0.log" Jul 23 19:48:28.515487 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:28.515460 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7hmlc_7bf27936-9b11-416c-92b9-61753d41a9ee/serve-healthcheck-canary/0.log" Jul 23 19:48:29.161319 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:29.161292 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbh9x_dd893597-7523-46c3-886b-675a283d18d6/kube-rbac-proxy/0.log" Jul 23 19:48:29.181078 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:29.181054 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbh9x_dd893597-7523-46c3-886b-675a283d18d6/exporter/0.log" Jul 23 19:48:29.202132 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:29.202112 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbh9x_dd893597-7523-46c3-886b-675a283d18d6/extractor/0.log" Jul 23 19:48:30.186612 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:30.186585 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5ctxw/perf-node-gather-daemonset-zkp7q" Jul 23 19:48:31.618670 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:31.618615 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-867878f755-cx2ns_dac81317-b139-42dc-8007-34bd6624d34e/manager/0.log" Jul 23 19:48:31.753113 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:31.753083 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6657c8cb8d-4z6n2_4b6f5504-f23c-4d87-8689-ec4a0fd00899/manager/0.log" Jul 23 19:48:31.774697 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:31.774675 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6657c8cb8d-4z6n2_4b6f5504-f23c-4d87-8689-ec4a0fd00899/copy-manifests/0.log" Jul 23 19:48:33.359590 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:33.359512 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-779d54d68-cw87c_3bc46626-3d19-4558-9415-5936e0b8292f/manager/0.log" Jul 23 19:48:33.418711 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:33.418684 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-56fqg_11ab72ae-2a7e-419d-8870-767d1f8a8cb9/openshift-lws-operator/0.log" Jul 23 19:48:33.494269 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:33.494239 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b646958c-wtgh7_7fb94798-9ee9-40f9-807e-54bdfb309a2b/kube-auth-proxy/0.log" Jul 23 19:48:33.561566 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:33.561535 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-swjqj_1e70a898-f17e-40b6-a2ce-a0aaa6dafc01/payload-pre-processing/0.log" Jul 23 19:48:33.582062 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:33.582037 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h6q9h_4bd6ea21-370b-4b7d-be4c-38e20943ad88/payload-processing/0.log" Jul 23 19:48:34.925578 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:34.925556 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b646958c-wtgh7_7fb94798-9ee9-40f9-807e-54bdfb309a2b/kube-auth-proxy/0.log" Jul 23 19:48:34.994708 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:34.994681 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-swjqj_1e70a898-f17e-40b6-a2ce-a0aaa6dafc01/payload-pre-processing/0.log" Jul 23 19:48:35.020932 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:35.020907 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h6q9h_4bd6ea21-370b-4b7d-be4c-38e20943ad88/payload-processing/0.log" Jul 23 19:48:39.811577 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:39.811552 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7kd28_d6f859d3-7891-4261-8bcc-7a0d3098f186/kube-multus/0.log" Jul 23 19:48:39.990481 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:39.990455 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/kube-multus-additional-cni-plugins/0.log" Jul 23 19:48:40.011496 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:40.011479 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/egress-router-binary-copy/0.log" Jul 23 19:48:40.031947 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:40.031927 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/cni-plugins/0.log" Jul 23 19:48:40.052156 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:40.052135 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/bond-cni-plugin/0.log" Jul 23 19:48:40.073197 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:40.073137 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/routeoverride-cni/0.log" Jul 23 19:48:40.093574 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:40.093555 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/whereabouts-cni-bincopy/0.log" Jul 23 19:48:40.114642 ip-10-0-128-42 kubenswrapper[2569]: I0723 19:48:40.114619 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhqvp_9b5a389d-3d26-4712-afd7-215689dd0aa1/whereabouts-cni/0.log"