Jul 01 22:36:25.275260 ip-10-0-141-227 systemd[1]: Starting Kubernetes Kubelet... Jul 01 22:36:25.624271 ip-10-0-141-227 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:36:25.624271 ip-10-0-141-227 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 22:36:25.624271 ip-10-0-141-227 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:36:25.624271 ip-10-0-141-227 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 22:36:25.624271 ip-10-0-141-227 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:36:25.625144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.625054 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 22:36:25.629638 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629616 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:36:25.629638 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629639 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629645 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629650 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629653 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629657 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629660 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629664 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629676 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629679 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629682 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629685 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629688 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629690 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629693 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629696 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629699 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629701 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629704 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629707 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629710 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:36:25.629725 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629713 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629716 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629719 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629722 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629725 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629728 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629731 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629734 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629737 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629741 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629745 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629747 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629750 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629753 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629756 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629758 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629761 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629764 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629766 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:36:25.630255 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629772 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629776 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629779 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629782 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629785 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629788 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629790 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629793 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629796 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629799 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629802 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629805 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629808 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629811 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629813 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629817 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629821 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629824 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629827 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629830 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:36:25.630830 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629833 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629835 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629838 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629841 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629844 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629847 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629849 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629853 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629856 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629858 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629861 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629864 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629867 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629870 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629874 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629878 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629881 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629884 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629887 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:36:25.631613 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629891 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629893 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629896 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629900 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629902 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629905 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629908 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629910 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629915 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629918 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629921 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629925 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629928 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629930 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629933 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629936 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629939 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629942 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629944 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.629947 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:36:25.632214 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632128 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632145 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632149 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632152 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632155 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632158 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632162 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632165 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632167 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632170 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632173 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632176 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632179 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632188 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632193 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632197 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632200 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632202 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632205 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632208 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:36:25.632716 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632211 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632214 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632217 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632220 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632223 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632226 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632229 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632232 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632234 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632237 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632240 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632247 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632250 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632253 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632256 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632259 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632262 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632265 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632268 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632271 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:36:25.633317 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632273 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632276 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632281 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632286 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632290 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632293 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632296 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632299 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632302 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632304 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632307 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632310 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632313 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632316 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632319 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632322 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632325 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632328 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632331 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:36:25.633872 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632334 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632336 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632339 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632342 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632345 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632347 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632350 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632354 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632359 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632364 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632367 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632371 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632374 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632377 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632379 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632382 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632385 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632388 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632390 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:36:25.634388 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632393 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632396 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632398 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632401 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632404 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632408 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632411 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632414 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632418 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632422 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632426 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632429 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632432 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632435 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632438 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632440 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632443 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632446 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632449 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:36:25.634892 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632452 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632456 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632905 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632911 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632916 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632920 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632924 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632927 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632931 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632933 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632936 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632939 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632942 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632945 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632948 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632951 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632954 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632957 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632960 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632963 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:36:25.635414 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632966 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632969 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632971 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632974 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632977 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632980 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632982 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632985 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632988 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.632992 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633010 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633014 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633016 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633020 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633023 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633026 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633029 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633032 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633034 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633037 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:36:25.635926 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633040 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633042 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633045 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633048 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633050 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633053 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633056 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633059 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633061 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633064 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633067 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633071 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633073 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633076 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633079 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633081 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633086 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633090 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633094 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633097 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:36:25.636475 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633099 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633102 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633105 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633108 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633110 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633114 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633118 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633121 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633124 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633127 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633129 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633132 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633135 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633137 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633140 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633143 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633145 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633148 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633151 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633153 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:36:25.636985 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633156 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633159 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633161 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633164 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633167 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633172 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633175 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633178 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633181 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633184 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633187 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633190 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633193 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633196 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633199 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633202 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633205 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633211 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633214 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:36:25.637541 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633217 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633220 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633291 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633298 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633304 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633309 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633314 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633318 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633332 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633337 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633340 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633343 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633347 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633351 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633354 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633357 2579 flags.go:64] FLAG: --cgroup-root="" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633361 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633364 2579 flags.go:64] FLAG: --client-ca-file="" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633368 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633371 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633376 2579 flags.go:64] FLAG: --cluster-domain="" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633379 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633383 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633386 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 22:36:25.638090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633390 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633394 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633397 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633401 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633404 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633407 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633412 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633415 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633419 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633422 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633426 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633430 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633433 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633436 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633439 2579 flags.go:64] FLAG: --enable-server="true" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633443 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633448 2579 flags.go:64] FLAG: --event-burst="100" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633451 2579 flags.go:64] FLAG: --event-qps="50" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633454 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633457 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633460 2579 flags.go:64] FLAG: --eviction-hard="" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633465 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633468 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633471 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633474 2579 flags.go:64] FLAG: --eviction-soft="" Jul 01 22:36:25.638701 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633477 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633480 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633484 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633487 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633490 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633493 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633496 2579 flags.go:64] FLAG: --feature-gates="" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633500 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633503 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633506 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633510 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633513 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633517 2579 flags.go:64] FLAG: --help="false" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633521 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633525 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633528 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633532 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633535 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633539 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633542 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633545 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633548 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633551 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 22:36:25.639332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633554 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633557 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633560 2579 flags.go:64] FLAG: --kube-reserved="" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633563 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633566 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633569 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633572 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633575 2579 flags.go:64] FLAG: --lock-file="" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633579 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633582 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633585 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633591 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633595 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633598 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633601 2579 flags.go:64] FLAG: --logging-format="text" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633604 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633607 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633610 2579 flags.go:64] FLAG: --manifest-url="" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633613 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633618 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633621 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633625 2579 flags.go:64] FLAG: --max-pods="110" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633632 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633635 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633638 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 22:36:25.640024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633641 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633645 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633648 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633651 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633659 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633662 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633665 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633669 2579 flags.go:64] FLAG: --pod-cidr="" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633672 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633678 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633681 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633685 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633688 2579 flags.go:64] FLAG: --port="10250" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633691 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633694 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064db30097c85a117" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633698 2579 flags.go:64] FLAG: --qos-reserved="" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633701 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633704 2579 flags.go:64] FLAG: --register-node="true" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633707 2579 flags.go:64] FLAG: --register-with-taints="" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633716 2579 flags.go:64] FLAG: --registry-burst="10" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633720 2579 flags.go:64] FLAG: --registry-qps="5" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633723 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633726 2579 flags.go:64] FLAG: --reserved-memory="" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633731 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633734 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 22:36:25.640676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633737 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633740 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633743 2579 flags.go:64] FLAG: --runonce="false" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633746 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633750 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633754 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633757 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633761 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633764 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633767 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633770 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633773 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633776 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633779 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633782 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633786 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633789 2579 flags.go:64] FLAG: --system-cgroups="" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633792 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633798 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633801 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633804 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633809 2579 flags.go:64] FLAG: --tls-min-version="" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633813 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633816 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633819 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 22:36:25.641364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633822 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633826 2579 flags.go:64] FLAG: --v="2" Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633830 2579 flags.go:64] FLAG: --version="false" Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633835 2579 flags.go:64] FLAG: --vmodule="" Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633839 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.633842 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633969 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633973 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633976 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633979 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633982 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.633985 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634007 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634012 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634014 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634017 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634020 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634023 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634025 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634028 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634031 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:36:25.642104 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634034 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634037 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634040 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634043 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634046 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634049 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634051 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634054 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634059 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634061 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634064 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634067 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634070 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634072 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634075 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634079 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634081 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634084 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634087 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634090 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:36:25.642664 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634093 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634097 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634101 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634106 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634109 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634112 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634115 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634119 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634123 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634126 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634129 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634132 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634135 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634138 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634140 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634143 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634145 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634148 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634151 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:36:25.643199 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634154 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634159 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634161 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634164 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634167 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634169 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634172 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634175 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634178 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634181 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634184 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634187 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634189 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634194 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634197 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634200 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634205 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634207 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634210 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634213 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:36:25.643719 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634216 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634218 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634221 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634224 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634227 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634230 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634233 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634236 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634238 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634241 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634244 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634247 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634250 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634253 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634256 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634259 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634262 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634264 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634267 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:36:25.644245 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634269 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634273 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634275 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634279 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634281 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.634284 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.634290 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.643409 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.643427 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.643445 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.643452 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643514 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643519 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643523 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643527 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:36:25.644735 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643530 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643533 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643537 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643540 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643543 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643547 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643550 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643553 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643555 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643560 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643564 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643568 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643572 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643576 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643579 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643582 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643585 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643588 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643592 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:36:25.645184 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643596 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643599 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643602 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643605 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643608 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643611 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643615 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643618 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643621 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643624 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643627 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643630 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643633 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643636 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643639 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643642 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643645 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643647 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643650 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643653 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:36:25.645684 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643656 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643659 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643662 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643665 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643668 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643671 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643674 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643677 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643679 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643682 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643685 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643688 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643690 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643693 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643696 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643699 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643702 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643704 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643707 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643711 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:36:25.646287 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643714 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643717 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643720 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643723 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643726 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643729 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643732 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643735 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643738 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643742 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643746 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643749 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643752 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643755 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643757 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643760 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643763 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643766 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643768 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:36:25.646824 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643771 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643774 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643777 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643780 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643783 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643785 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643788 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643791 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643793 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643796 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643799 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643802 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643805 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643809 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643812 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643815 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:36:25.647398 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643817 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.643823 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643939 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643943 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643946 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643949 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643952 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643955 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643958 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643961 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643963 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643966 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643969 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643972 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643975 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:36:25.647822 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643977 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643980 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643983 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643986 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.643989 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644010 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644015 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644019 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644022 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644025 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644028 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644031 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644034 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644037 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644039 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644043 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644046 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644050 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644052 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644055 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:36:25.648252 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644058 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644061 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644063 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644066 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644069 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644071 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644074 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644077 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644080 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644083 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644086 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644089 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644094 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644097 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644099 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644102 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644105 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644108 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644111 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644114 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:36:25.648852 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644116 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644119 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644122 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644124 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644127 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644129 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644132 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644138 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644143 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644146 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644148 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644151 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644154 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644156 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644159 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644162 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644164 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644167 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644170 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:36:25.649429 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644172 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644175 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644178 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644181 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644185 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644189 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644192 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644196 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644198 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644201 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644204 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644207 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644210 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644212 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644215 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644218 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644221 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644224 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:36:25.649933 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644226 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644229 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644233 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644240 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644244 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644247 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644250 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644253 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:25.644255 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.644261 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.644389 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.646707 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.648182 2579 server.go:1019] "Starting client certificate rotation" Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.648304 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:36:25.650522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.648348 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:36:25.650909 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.650713 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:36:25.651984 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.651959 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:36:25.663218 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.663194 2579 log.go:25] "Validated CRI v1 runtime API" Jul 01 22:36:25.665575 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.665556 2579 log.go:25] "Validated CRI v1 image API" Jul 01 22:36:25.666516 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.666501 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 22:36:25.671427 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.671404 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c712b534-0c06-4d25-aeea-28dbae3426d9:/dev/nvme0n1p4 cb54a16c-1f49-4b48-8b79-375d5b1ae0a2:/dev/nvme0n1p3] Jul 01 22:36:25.671494 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.671426 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 22:36:25.677293 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.677150 2579 manager.go:216] Machine: {Timestamp:2026-07-01 22:36:25.675901254 +0000 UTC m=+0.299274799 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098400 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23595d24579cf422a49d668515bc13 SystemUUID:ec23595d-2457-9cf4-22a4-9d668515bc13 BootID:5f231e2e-286c-47f1-9313-f9b7180bb9a6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:65:ce:f1:a7:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:65:ce:f1:a7:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:96:42:31:9e:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 22:36:25.677293 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.677290 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 22:36:25.677401 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.677377 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 22:36:25.679088 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.679056 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 22:36:25.679244 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.679092 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 22:36:25.680519 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.680508 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 22:36:25.680552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.680523 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 22:36:25.680552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.680536 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:36:25.681182 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.681169 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:36:25.682299 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.682288 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 22:36:25.685170 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685155 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:36:25.685713 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685701 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:36:25.685846 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685836 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 22:36:25.685877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685870 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 01 22:36:25.685905 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685879 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 22:36:25.685905 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685894 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 22:36:25.685905 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685903 2579 kubelet.go:398] "Adding apiserver pod source" Jul 01 22:36:25.685988 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.685913 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 22:36:25.686303 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.686291 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:36:25.686355 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.686322 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:36:25.688812 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.688795 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 22:36:25.691073 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691057 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 22:36:25.691152 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691088 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 22:36:25.691853 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691839 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 22:36:25.691902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691859 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 22:36:25.691902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691867 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 22:36:25.691902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691876 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 22:36:25.691902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691888 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 22:36:25.691902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691894 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 22:36:25.691902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691903 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 22:36:25.692102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691908 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 22:36:25.692102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691931 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 22:36:25.692102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691937 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 22:36:25.692102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691949 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 22:36:25.692102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.691956 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 22:36:25.692639 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.692629 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 22:36:25.692674 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.692639 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 22:36:25.696384 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.696367 2579 server.go:1268] "Started kubelet" Jul 01 22:36:25.696473 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.696412 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 22:36:25.696566 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.696518 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 22:36:25.696621 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.696591 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 22:36:25.697444 ip-10-0-141-227 systemd[1]: Started Kubernetes Kubelet. Jul 01 22:36:25.698364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.698349 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 22:36:25.699657 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.699635 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 01 22:36:25.702353 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.702330 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-227.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 22:36:25.702462 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.702334 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 22:36:25.702563 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.702501 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 22:36:25.704245 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.704222 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 22:36:25.706870 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.705781 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-227.ec2.internal.18be4b61c059a4f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-227.ec2.internal,UID:ip-10-0-141-227.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-227.ec2.internal,},FirstTimestamp:2026-07-01 22:36:25.696306416 +0000 UTC m=+0.319679961,LastTimestamp:2026-07-01 22:36:25.696306416 +0000 UTC m=+0.319679961,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-227.ec2.internal,}" Jul 01 22:36:25.710414 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.710220 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 22:36:25.710414 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.710235 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 22:36:25.710414 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.710363 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:25.710925 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.710874 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 22:36:25.710925 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.710916 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 22:36:25.710925 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.710925 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 22:36:25.711114 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711093 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 01 22:36:25.711114 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711104 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 01 22:36:25.711385 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711362 2579 factory.go:55] Registering systemd factory Jul 01 22:36:25.711464 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711388 2579 factory.go:223] Registration of the systemd container factory successfully Jul 01 22:36:25.711634 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711615 2579 factory.go:153] Registering CRI-O factory Jul 01 22:36:25.711634 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711632 2579 factory.go:223] Registration of the crio container factory successfully Jul 01 22:36:25.711784 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711695 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 22:36:25.711784 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711722 2579 factory.go:103] Registering Raw factory Jul 01 22:36:25.711784 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.711740 2579 manager.go:1196] Started watching for new ooms in manager Jul 01 22:36:25.712299 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.712280 2579 manager.go:349] Starting recovery of all containers Jul 01 22:36:25.713507 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.713476 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 22:36:25.713605 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.713583 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 22:36:25.713733 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.713715 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-frs6k" Jul 01 22:36:25.719672 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.719632 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 22:36:25.721241 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.721218 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-frs6k" Jul 01 22:36:25.724251 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.724235 2579 manager.go:354] Recovery completed Jul 01 22:36:25.728470 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.728457 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.730756 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.730742 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.730816 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.730770 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.730816 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.730781 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.732179 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732161 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 22:36:25.732179 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732179 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.732179 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732183 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 22:36:25.732340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732198 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:36:25.732934 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732919 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.733013 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732969 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.733013 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.732982 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.733926 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.733914 2579 policy_none.go:49] "None policy: Start" Jul 01 22:36:25.733965 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.733934 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 22:36:25.733965 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.733944 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 22:36:25.734892 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.734879 2579 policy_none.go:47] "Start" Jul 01 22:36:25.766727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.766707 2579 manager.go:337] "Starting Device Plugin manager" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.766750 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.766764 2579 server.go:87] "Starting device plugin registration server" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.767109 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.767134 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.767264 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.767355 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.767366 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.768034 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.768082 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.778663 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.778701 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.778720 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 22:36:25.785158 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.778751 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 22:36:25.785697 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.785682 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:36:25.868089 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.868003 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.869114 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.869094 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.869209 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.869127 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.869209 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.869139 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.869209 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.869170 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.879552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.879530 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal"] Jul 01 22:36:25.879629 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.879616 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.881131 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.881117 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.881188 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.881144 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.881188 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.881154 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.882357 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.882344 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.882492 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.882478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.882536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.882509 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.883096 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.883079 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.883178 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.883113 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.883178 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.883124 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.883178 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.883085 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.883288 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.883188 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.883288 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.883200 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.884258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.884239 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.884358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.884264 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:36:25.884924 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.884908 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:36:25.885005 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.884935 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:36:25.885005 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.884964 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:36:25.895322 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.895308 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.895384 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.895329 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-227.ec2.internal\": node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:25.912474 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.912452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73e85c093366a421d56993574a095b9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal\" (UID: \"73e85c093366a421d56993574a095b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.912531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.912482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73e85c093366a421d56993574a095b9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal\" (UID: \"73e85c093366a421d56993574a095b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.912531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:25.912498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/380076dd55b07509cfcb1ff3be99347f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-227.ec2.internal\" (UID: \"380076dd55b07509cfcb1ff3be99347f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.918856 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.918834 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-227.ec2.internal\" not found" node="ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.923780 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.923764 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-227.ec2.internal\" not found" node="ip-10-0-141-227.ec2.internal" Jul 01 22:36:25.957525 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:25.957491 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.012641 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.012615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73e85c093366a421d56993574a095b9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal\" (UID: \"73e85c093366a421d56993574a095b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.012795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.012652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73e85c093366a421d56993574a095b9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal\" (UID: \"73e85c093366a421d56993574a095b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.012795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.012679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/380076dd55b07509cfcb1ff3be99347f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-227.ec2.internal\" (UID: \"380076dd55b07509cfcb1ff3be99347f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.012795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.012730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/380076dd55b07509cfcb1ff3be99347f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-227.ec2.internal\" (UID: \"380076dd55b07509cfcb1ff3be99347f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.012795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.012740 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73e85c093366a421d56993574a095b9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal\" (UID: \"73e85c093366a421d56993574a095b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.012795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.012740 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73e85c093366a421d56993574a095b9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal\" (UID: \"73e85c093366a421d56993574a095b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.058050 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.058024 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.158843 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.158762 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.221891 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.221853 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.228390 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.228253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" Jul 01 22:36:26.259701 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.259672 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.361644 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.361606 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.464187 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.464119 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.566993 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.566964 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.647258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.647229 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 22:36:26.647662 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.647359 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 22:36:26.657778 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.657758 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:36:26.667650 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.667628 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.726812 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.726726 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 22:31:25 +0000 UTC" deadline="2028-01-04 15:04:13.822272123 +0000 UTC" Jul 01 22:36:26.726812 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.726764 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13240h27m47.09551158s" Jul 01 22:36:26.768066 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.767896 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.776977 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:26.776925 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e85c093366a421d56993574a095b9e.slice/crio-d417bc6452fdc916732c9fec1ede572c7a30b6d79094d9afbce33ba6e4aba46c WatchSource:0}: Error finding container d417bc6452fdc916732c9fec1ede572c7a30b6d79094d9afbce33ba6e4aba46c: Status 404 returned error can't find the container with id d417bc6452fdc916732c9fec1ede572c7a30b6d79094d9afbce33ba6e4aba46c Jul 01 22:36:26.777176 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:26.777156 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380076dd55b07509cfcb1ff3be99347f.slice/crio-41a0df8015edbfa797c7cc85419b0817f34e0c5fc0f590e3c9b4d61d6d708553 WatchSource:0}: Error finding container 41a0df8015edbfa797c7cc85419b0817f34e0c5fc0f590e3c9b4d61d6d708553: Status 404 returned error can't find the container with id 41a0df8015edbfa797c7cc85419b0817f34e0c5fc0f590e3c9b4d61d6d708553 Jul 01 22:36:26.782367 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.782346 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:36:26.782545 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.782499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" event={"ID":"380076dd55b07509cfcb1ff3be99347f","Type":"ContainerStarted","Data":"41a0df8015edbfa797c7cc85419b0817f34e0c5fc0f590e3c9b4d61d6d708553"} Jul 01 22:36:26.783517 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.783501 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" event={"ID":"73e85c093366a421d56993574a095b9e","Type":"ContainerStarted","Data":"d417bc6452fdc916732c9fec1ede572c7a30b6d79094d9afbce33ba6e4aba46c"} Jul 01 22:36:26.868754 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.868713 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.930175 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.930150 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:36:26.969183 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:26.969151 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-227.ec2.internal\" not found" Jul 01 22:36:26.993508 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:26.993445 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:36:27.011556 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.011530 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" Jul 01 22:36:27.041244 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.041224 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:36:27.042125 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.042112 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" Jul 01 22:36:27.055444 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.055424 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:36:27.528711 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.528644 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:36:27.687546 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.687523 2579 apiserver.go:52] "Watching apiserver" Jul 01 22:36:27.694636 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.694610 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 22:36:27.695690 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.695670 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pvzbn","kube-system/konnectivity-agent-nm7bc","openshift-image-registry/node-ca-j7td8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal","openshift-multus/multus-additional-cni-plugins-cxgtb","openshift-network-diagnostics/network-check-target-t4t8t","kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n","openshift-cluster-node-tuning-operator/tuned-7rtnj","openshift-dns/node-resolver-q4szn","openshift-multus/multus-cmg72","openshift-multus/network-metrics-daemon-gkh8w","openshift-network-operator/iptables-alerter-cl4s9","openshift-ovn-kubernetes/ovnkube-node-bj769"] Jul 01 22:36:27.698044 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.698022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.700477 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.700457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.700665 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.700598 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 22:36:27.700849 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.700831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 22:36:27.701484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.701466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mlk8n\"" Jul 01 22:36:27.702371 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.702354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.702578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.702464 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 22:36:27.702801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.702785 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.702961 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.702924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.703039 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.703027 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n9kk7\"" Jul 01 22:36:27.704690 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.704671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.707003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.706984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.707122 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.707064 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:27.707192 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.707136 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8jbl5\"" Jul 01 22:36:27.707927 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.707912 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.708060 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.708042 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 22:36:27.708060 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.708043 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.709064 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.708869 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 22:36:27.709064 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.709005 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dsnmh\"" Jul 01 22:36:27.709064 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.709050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.709254 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.709085 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.709431 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.709415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.710886 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.710868 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 22:36:27.711667 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.711651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:27.711756 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.711713 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:27.712476 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.712236 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 22:36:27.712476 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.712378 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.712476 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.712379 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 22:36:27.712476 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.712397 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.712853 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.712764 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-27vsc\"" Jul 01 22:36:27.714102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.713834 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 22:36:27.714527 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.714420 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.717723 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.717701 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.718016 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.718360 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718342 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 22:36:27.718449 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718344 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 22:36:27.718449 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718439 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.718731 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718713 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 22:36:27.718731 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718717 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z9652\"" Jul 01 22:36:27.718811 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.718730 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 22:36:27.720486 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.720469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.720558 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.720521 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.720797 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.720782 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.721167 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bed3d9c-abca-4cd4-983d-ad8c577da731-host-slash\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.721281 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-os-release\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.721281 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edb0714f-f44d-48d5-836c-198f20121771-konnectivity-ca\") pod \"konnectivity-agent-nm7bc\" (UID: \"edb0714f-f44d-48d5-836c-198f20121771\") " pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.721281 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:27.721281 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.721281 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-serviceca\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-registration-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-sys-fs\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkfv9\" (UniqueName: \"kubernetes.io/projected/6026a364-be43-4ba4-95f6-9efd779d2e1f-kube-api-access-nkfv9\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smsjw\" (UniqueName: \"kubernetes.io/projected/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-kube-api-access-smsjw\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlk9p\" (UniqueName: \"kubernetes.io/projected/12585b4a-528b-4757-b872-d347bbb305ee-kube-api-access-wlk9p\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.721531 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8bed3d9c-abca-4cd4-983d-ad8c577da731-iptables-alerter-script\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edb0714f-f44d-48d5-836c-198f20121771-agent-certs\") pod \"konnectivity-agent-nm7bc\" (UID: \"edb0714f-f44d-48d5-836c-198f20121771\") " pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-device-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-cnibin\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-host\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87cc096e-5f44-4471-bf7e-32d1c1032602-kubelet-config\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-socket-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs76x\" (UniqueName: \"kubernetes.io/projected/8bed3d9c-abca-4cd4-983d-ad8c577da731-kube-api-access-rs76x\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87cc096e-5f44-4471-bf7e-32d1c1032602-dbus\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-system-cni-dir\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.722011 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.721808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.722724 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.722329 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zbl5f\"" Jul 01 22:36:27.723036 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.723020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.724694 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.724663 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v5pmk\"" Jul 01 22:36:27.724868 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.724854 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 22:36:27.724996 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.724977 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 22:36:27.725098 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.725079 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 22:36:27.725350 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.725332 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cfpmb\"" Jul 01 22:36:27.725450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.725434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:27.725540 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.725523 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:27.728489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.728453 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:36:27.761036 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.761018 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vfxbb" Jul 01 22:36:27.768278 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.768257 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vfxbb" Jul 01 22:36:27.812480 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.812399 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 22:36:27.822538 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-tmp-dir\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.822538 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.822727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-cni-multus\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.822727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-hostroot\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.822727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bed3d9c-abca-4cd4-983d-ad8c577da731-host-slash\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.822727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-os-release\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.822727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrh7n\" (UniqueName: \"kubernetes.io/projected/e19c94f3-ba11-47e2-b4e8-8af69106a41c-kube-api-access-vrh7n\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.822727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6blr7\" (UniqueName: \"kubernetes.io/projected/c5e75a35-40d9-4c4c-9452-2b20911f2643-kube-api-access-6blr7\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edb0714f-f44d-48d5-836c-198f20121771-konnectivity-ca\") pod \"konnectivity-agent-nm7bc\" (UID: \"edb0714f-f44d-48d5-836c-198f20121771\") " pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bed3d9c-abca-4cd4-983d-ad8c577da731-host-slash\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822760 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysctl-conf\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-cni-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-cni-bin\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-serviceca\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.822978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frvr\" (UniqueName: \"kubernetes.io/projected/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-kube-api-access-7frvr\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-etc-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.823031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-node-log\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-conf-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkfv9\" (UniqueName: \"kubernetes.io/projected/6026a364-be43-4ba4-95f6-9efd779d2e1f-kube-api-access-nkfv9\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-run-ovn-kubernetes\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-var-lib-kubelet\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-tuned\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-os-release\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e75a35-40d9-4c4c-9452-2b20911f2643-tmp\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e52e9b-d950-4e11-b03a-22e08ce784ae-cni-binary-copy\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-daemon-config\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smsjw\" (UniqueName: \"kubernetes.io/projected/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-kube-api-access-smsjw\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-serviceca\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-var-lib-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmmq\" (UniqueName: \"kubernetes.io/projected/09e52e9b-d950-4e11-b03a-22e08ce784ae-kube-api-access-9pmmq\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823429 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-systemd-units\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.823484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-slash\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-run-netns\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-ovn\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-socket-dir-parent\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovn-node-metrics-cert\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-host\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87cc096e-5f44-4471-bf7e-32d1c1032602-kubelet-config\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823708 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87cc096e-5f44-4471-bf7e-32d1c1032602-kubelet-config\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-cni-bin\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823732 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-host\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-env-overrides\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823754 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edb0714f-f44d-48d5-836c-198f20121771-konnectivity-ca\") pod \"konnectivity-agent-nm7bc\" (UID: \"edb0714f-f44d-48d5-836c-198f20121771\") " pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-system-cni-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-etc-kubernetes\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-modprobe-d\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs76x\" (UniqueName: \"kubernetes.io/projected/8bed3d9c-abca-4cd4-983d-ad8c577da731-kube-api-access-rs76x\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.824138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-system-cni-dir\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.823957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824000 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-system-cni-dir\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysctl-d\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-host\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-netns\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-kubelet\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovnkube-config\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-sys\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-k8s-cni-cncf-io\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovnkube-script-lib\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824367 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysconfig\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-registration-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.824791 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-sys-fs\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824483 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-systemd\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824528 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-registration-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-kubernetes\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824548 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-sys-fs\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-multus-certs\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlk9p\" (UniqueName: \"kubernetes.io/projected/12585b4a-528b-4757-b872-d347bbb305ee-kube-api-access-wlk9p\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824783 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8bed3d9c-abca-4cd4-983d-ad8c577da731-iptables-alerter-script\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-hosts-file\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-cni-netd\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-os-release\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edb0714f-f44d-48d5-836c-198f20121771-agent-certs\") pod \"konnectivity-agent-nm7bc\" (UID: \"edb0714f-f44d-48d5-836c-198f20121771\") " pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.825542 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-device-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6026a364-be43-4ba4-95f6-9efd779d2e1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.824996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-cnibin\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkp7w\" (UniqueName: \"kubernetes.io/projected/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-kube-api-access-wkp7w\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-log-socket\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-device-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-systemd\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-kubelet\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6026a364-be43-4ba4-95f6-9efd779d2e1f-cnibin\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-run\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.825140 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-lib-modules\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.825204 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:28.325183244 +0000 UTC m=+2.948556780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-cnibin\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.826149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-socket-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.826815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8bed3d9c-abca-4cd4-983d-ad8c577da731-iptables-alerter-script\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.826815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87cc096e-5f44-4471-bf7e-32d1c1032602-dbus\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.826815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825333 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 22:36:27.826815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825328 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.826815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825441 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12585b4a-528b-4757-b872-d347bbb305ee-socket-dir\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.826815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.825487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87cc096e-5f44-4471-bf7e-32d1c1032602-dbus\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:27.828818 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.828801 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edb0714f-f44d-48d5-836c-198f20121771-agent-certs\") pod \"konnectivity-agent-nm7bc\" (UID: \"edb0714f-f44d-48d5-836c-198f20121771\") " pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:27.832929 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.832910 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:27.833048 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.832948 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:27.833048 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.832963 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:27.833048 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.833035 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:28.333017674 +0000 UTC m=+2.956391222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:27.833914 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.833885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs76x\" (UniqueName: \"kubernetes.io/projected/8bed3d9c-abca-4cd4-983d-ad8c577da731-kube-api-access-rs76x\") pod \"iptables-alerter-cl4s9\" (UID: \"8bed3d9c-abca-4cd4-983d-ad8c577da731\") " pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:27.834402 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.834383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smsjw\" (UniqueName: \"kubernetes.io/projected/9bce97ef-3fee-453a-b1a1-cd2da6b6445e-kube-api-access-smsjw\") pod \"node-ca-j7td8\" (UID: \"9bce97ef-3fee-453a-b1a1-cd2da6b6445e\") " pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:27.835657 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.835631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkfv9\" (UniqueName: \"kubernetes.io/projected/6026a364-be43-4ba4-95f6-9efd779d2e1f-kube-api-access-nkfv9\") pod \"multus-additional-cni-plugins-cxgtb\" (UID: \"6026a364-be43-4ba4-95f6-9efd779d2e1f\") " pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:27.836345 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.836328 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlk9p\" (UniqueName: \"kubernetes.io/projected/12585b4a-528b-4757-b872-d347bbb305ee-kube-api-access-wlk9p\") pod \"aws-ebs-csi-driver-node-5874n\" (UID: \"12585b4a-528b-4757-b872-d347bbb305ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:27.926089 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frvr\" (UniqueName: \"kubernetes.io/projected/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-kube-api-access-7frvr\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-etc-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-node-log\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-conf-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-run-ovn-kubernetes\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-var-lib-kubelet\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-tuned\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e75a35-40d9-4c4c-9452-2b20911f2643-tmp\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.926277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e52e9b-d950-4e11-b03a-22e08ce784ae-cni-binary-copy\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-daemon-config\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-var-lib-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-run-ovn-kubernetes\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmmq\" (UniqueName: \"kubernetes.io/projected/09e52e9b-d950-4e11-b03a-22e08ce784ae-kube-api-access-9pmmq\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-systemd-units\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926398 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-etc-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-slash\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-conf-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-run-netns\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-var-lib-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-ovn\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926484 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-run-netns\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-socket-dir-parent\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926521 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-node-log\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovn-node-metrics-cert\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-var-lib-kubelet\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926528 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-systemd-units\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.926671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-slash\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-cni-bin\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926558 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-ovn\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926590 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-socket-dir-parent\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-cni-bin\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-env-overrides\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-system-cni-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-etc-kubernetes\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-modprobe-d\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysctl-d\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-host\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-netns\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-kubelet\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovnkube-config\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926971 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-system-cni-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-daemon-config\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.927578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926983 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e52e9b-d950-4e11-b03a-22e08ce784ae-cni-binary-copy\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927014 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-etc-kubernetes\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927031 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-host\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-netns\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927041 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-kubelet\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.926986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-sys\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-k8s-cni-cncf-io\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovnkube-script-lib\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-modprobe-d\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysconfig\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927165 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysconfig\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-systemd\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-k8s-cni-cncf-io\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-sys\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-env-overrides\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-kubernetes\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927239 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-systemd\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927241 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-kubernetes\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.928418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysctl-d\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-multus-certs\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-hosts-file\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-cni-netd\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-os-release\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-run-multus-certs\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkp7w\" (UniqueName: \"kubernetes.io/projected/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-kube-api-access-wkp7w\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927398 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-hosts-file\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-log-socket\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-systemd\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-os-release\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-kubelet\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-log-socket\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-cni-netd\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovnkube-config\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-run\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927542 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-run\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927549 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-host-kubelet\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.929258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-lib-modules\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927589 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-systemd\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-cnibin\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-tmp-dir\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovnkube-script-lib\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927641 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-cnibin\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-cni-multus\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-lib-modules\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-hostroot\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-cni-multus\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e19c94f3-ba11-47e2-b4e8-8af69106a41c-run-openvswitch\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrh7n\" (UniqueName: \"kubernetes.io/projected/e19c94f3-ba11-47e2-b4e8-8af69106a41c-kube-api-access-vrh7n\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-hostroot\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6blr7\" (UniqueName: \"kubernetes.io/projected/c5e75a35-40d9-4c4c-9452-2b20911f2643-kube-api-access-6blr7\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysctl-conf\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-cni-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-cni-bin\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.927964 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-multus-cni-dir\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.927882 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-tmp-dir\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:27.928023 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:28.42800842 +0000 UTC m=+3.051381971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.928026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09e52e9b-d950-4e11-b03a-22e08ce784ae-host-var-lib-cni-bin\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.928055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-sysctl-conf\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.929265 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e75a35-40d9-4c4c-9452-2b20911f2643-tmp\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.929377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e19c94f3-ba11-47e2-b4e8-8af69106a41c-ovn-node-metrics-cert\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:27.930798 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.930459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c5e75a35-40d9-4c4c-9452-2b20911f2643-etc-tuned\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.935388 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.935363 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frvr\" (UniqueName: \"kubernetes.io/projected/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-kube-api-access-7frvr\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:27.935521 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.935438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmmq\" (UniqueName: \"kubernetes.io/projected/09e52e9b-d950-4e11-b03a-22e08ce784ae-kube-api-access-9pmmq\") pod \"multus-cmg72\" (UID: \"09e52e9b-d950-4e11-b03a-22e08ce784ae\") " pod="openshift-multus/multus-cmg72" Jul 01 22:36:27.936149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.936121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkp7w\" (UniqueName: \"kubernetes.io/projected/ca4fa93a-08d5-41fc-ad68-8dc4671b0e79-kube-api-access-wkp7w\") pod \"node-resolver-q4szn\" (UID: \"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79\") " pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:27.937889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.937865 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6blr7\" (UniqueName: \"kubernetes.io/projected/c5e75a35-40d9-4c4c-9452-2b20911f2643-kube-api-access-6blr7\") pod \"tuned-7rtnj\" (UID: \"c5e75a35-40d9-4c4c-9452-2b20911f2643\") " pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:27.937985 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:27.937966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrh7n\" (UniqueName: \"kubernetes.io/projected/e19c94f3-ba11-47e2-b4e8-8af69106a41c-kube-api-access-vrh7n\") pod \"ovnkube-node-bj769\" (UID: \"e19c94f3-ba11-47e2-b4e8-8af69106a41c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:28.008320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.008292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:28.018173 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.018153 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" Jul 01 22:36:28.025631 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.025608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cl4s9" Jul 01 22:36:28.030216 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.030199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j7td8" Jul 01 22:36:28.037675 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.037656 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" Jul 01 22:36:28.042273 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.042256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:28.049804 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.049782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" Jul 01 22:36:28.055570 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.055553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q4szn" Jul 01 22:36:28.061266 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.061246 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmg72" Jul 01 22:36:28.330593 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.330514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:28.330723 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.330672 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:28.330811 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.330798 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.330772858 +0000 UTC m=+3.954146389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:28.431572 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.431538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:28.431737 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.431608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:28.431737 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.431705 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:28.431737 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.431721 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:28.431897 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.431793 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.431778266 +0000 UTC m=+4.055151812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:28.431897 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.431726 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:28.431897 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.431823 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:28.432022 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:28.431927 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.431908132 +0000 UTC m=+4.055281666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:28.714207 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.714160 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e52e9b_d950_4e11_b03a_22e08ce784ae.slice/crio-52714d9be3572e2faee371ded163c7e028e342158ad24f425f199687344f7fb3 WatchSource:0}: Error finding container 52714d9be3572e2faee371ded163c7e028e342158ad24f425f199687344f7fb3: Status 404 returned error can't find the container with id 52714d9be3572e2faee371ded163c7e028e342158ad24f425f199687344f7fb3 Jul 01 22:36:28.717186 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.717169 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4fa93a_08d5_41fc_ad68_8dc4671b0e79.slice/crio-d454f663079410502dcbae4dae5671018079e93570dbb4ef4940d73be99daf08 WatchSource:0}: Error finding container d454f663079410502dcbae4dae5671018079e93570dbb4ef4940d73be99daf08: Status 404 returned error can't find the container with id d454f663079410502dcbae4dae5671018079e93570dbb4ef4940d73be99daf08 Jul 01 22:36:28.717874 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.717842 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e75a35_40d9_4c4c_9452_2b20911f2643.slice/crio-ae06c83464495582269ba7737a600330d0f5b3c26ed266553839d16039ade65d WatchSource:0}: Error finding container ae06c83464495582269ba7737a600330d0f5b3c26ed266553839d16039ade65d: Status 404 returned error can't find the container with id ae06c83464495582269ba7737a600330d0f5b3c26ed266553839d16039ade65d Jul 01 22:36:28.719083 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.719059 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19c94f3_ba11_47e2_b4e8_8af69106a41c.slice/crio-d85683666b244091fd656bc365e2d4aaa3bea4fe422bfa32819858ced04a0fba WatchSource:0}: Error finding container d85683666b244091fd656bc365e2d4aaa3bea4fe422bfa32819858ced04a0fba: Status 404 returned error can't find the container with id d85683666b244091fd656bc365e2d4aaa3bea4fe422bfa32819858ced04a0fba Jul 01 22:36:28.719512 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.719485 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6026a364_be43_4ba4_95f6_9efd779d2e1f.slice/crio-370edc38bcbbf2e0e37f222eed33048e881fcb893afc9fa141511327ad94e76f WatchSource:0}: Error finding container 370edc38bcbbf2e0e37f222eed33048e881fcb893afc9fa141511327ad94e76f: Status 404 returned error can't find the container with id 370edc38bcbbf2e0e37f222eed33048e881fcb893afc9fa141511327ad94e76f Jul 01 22:36:28.720144 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.720121 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb0714f_f44d_48d5_836c_198f20121771.slice/crio-797bd99d0ab4d4d8acc83ec9b9524afeb988d5003b184f4bb203754f96085488 WatchSource:0}: Error finding container 797bd99d0ab4d4d8acc83ec9b9524afeb988d5003b184f4bb203754f96085488: Status 404 returned error can't find the container with id 797bd99d0ab4d4d8acc83ec9b9524afeb988d5003b184f4bb203754f96085488 Jul 01 22:36:28.723667 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:36:28.723075 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12585b4a_528b_4757_b872_d347bbb305ee.slice/crio-5eea0bcc55ae858b7ad87e503ea78c6417b88276fc0dbddafa2e4e866a640b34 WatchSource:0}: Error finding container 5eea0bcc55ae858b7ad87e503ea78c6417b88276fc0dbddafa2e4e866a640b34: Status 404 returned error can't find the container with id 5eea0bcc55ae858b7ad87e503ea78c6417b88276fc0dbddafa2e4e866a640b34 Jul 01 22:36:28.772323 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.772271 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:31:27 +0000 UTC" deadline="2028-03-24 16:41:33.370341632 +0000 UTC" Jul 01 22:36:28.772323 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.772313 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15162h5m4.598031267s" Jul 01 22:36:28.786553 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.786473 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j7td8" event={"ID":"9bce97ef-3fee-453a-b1a1-cd2da6b6445e","Type":"ContainerStarted","Data":"ac1490bc0bf1c9df3f5fa2d9f55a74f62d4fbe98adc027437482f25322237917"} Jul 01 22:36:28.787503 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.787477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nm7bc" event={"ID":"edb0714f-f44d-48d5-836c-198f20121771","Type":"ContainerStarted","Data":"797bd99d0ab4d4d8acc83ec9b9524afeb988d5003b184f4bb203754f96085488"} Jul 01 22:36:28.788561 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.788537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"d85683666b244091fd656bc365e2d4aaa3bea4fe422bfa32819858ced04a0fba"} Jul 01 22:36:28.789669 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.789649 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q4szn" event={"ID":"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79","Type":"ContainerStarted","Data":"d454f663079410502dcbae4dae5671018079e93570dbb4ef4940d73be99daf08"} Jul 01 22:36:28.790707 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.790689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmg72" event={"ID":"09e52e9b-d950-4e11-b03a-22e08ce784ae","Type":"ContainerStarted","Data":"52714d9be3572e2faee371ded163c7e028e342158ad24f425f199687344f7fb3"} Jul 01 22:36:28.791624 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.791606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" event={"ID":"12585b4a-528b-4757-b872-d347bbb305ee","Type":"ContainerStarted","Data":"5eea0bcc55ae858b7ad87e503ea78c6417b88276fc0dbddafa2e4e866a640b34"} Jul 01 22:36:28.792638 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.792621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerStarted","Data":"370edc38bcbbf2e0e37f222eed33048e881fcb893afc9fa141511327ad94e76f"} Jul 01 22:36:28.793697 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.793679 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" event={"ID":"c5e75a35-40d9-4c4c-9452-2b20911f2643","Type":"ContainerStarted","Data":"ae06c83464495582269ba7737a600330d0f5b3c26ed266553839d16039ade65d"} Jul 01 22:36:28.794793 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:28.794769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cl4s9" event={"ID":"8bed3d9c-abca-4cd4-983d-ad8c577da731","Type":"ContainerStarted","Data":"8e66d834413d2b4034c560695f75741b1a076bf9ff32737fbe70c73905a82e56"} Jul 01 22:36:29.338550 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.338264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:29.338715 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.338638 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:29.338772 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.338745 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:31.338726627 +0000 UTC m=+5.962100171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:29.439041 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.439005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:29.439209 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.439075 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:29.439282 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.439238 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:29.439282 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.439257 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:29.439282 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.439270 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:29.439429 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.439327 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:31.439308321 +0000 UTC m=+6.062681853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:29.439734 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.439715 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:29.439801 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.439780 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:31.439756308 +0000 UTC m=+6.063129856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:29.773102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.773015 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:31:27 +0000 UTC" deadline="2027-12-07 06:49:49.367078925 +0000 UTC" Jul 01 22:36:29.773102 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.773052 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12560h13m19.594031507s" Jul 01 22:36:29.782889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.779435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:29.782889 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.779557 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:29.782889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.780106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:29.782889 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.780219 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:29.782889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.780315 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:29.782889 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:29.780411 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:29.821599 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.821087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" event={"ID":"380076dd55b07509cfcb1ff3be99347f","Type":"ContainerStarted","Data":"23b548bf9064ed8d2a1de8792aa2a7301034c4d89107701d1ae8c9181b75bb74"} Jul 01 22:36:29.837978 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.837926 2579 generic.go:356] "Generic (PLEG): container finished" podID="73e85c093366a421d56993574a095b9e" containerID="b9d0de326492d9b1b2320aaf9872526692043c06f34deb1eca763155775f668d" exitCode=0 Jul 01 22:36:29.838146 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.838001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" event={"ID":"73e85c093366a421d56993574a095b9e","Type":"ContainerDied","Data":"b9d0de326492d9b1b2320aaf9872526692043c06f34deb1eca763155775f668d"} Jul 01 22:36:29.897826 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:29.896711 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-227.ec2.internal" podStartSLOduration=2.8966869429999997 podStartE2EDuration="2.896686943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:29.856549942 +0000 UTC m=+4.479923494" watchObservedRunningTime="2026-07-01 22:36:29.896686943 +0000 UTC m=+4.520060496" Jul 01 22:36:30.847846 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:30.847810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" event={"ID":"73e85c093366a421d56993574a095b9e","Type":"ContainerStarted","Data":"204cd90a257d24b810473ec7af03331b66b0c6b36eeab4935d3572a04b27447c"} Jul 01 22:36:31.353839 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:31.353805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:31.354040 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.354023 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:31.354110 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.354094 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:35.354075293 +0000 UTC m=+9.977448823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:31.455132 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:31.455096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:31.455296 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:31.455168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:31.455369 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.455326 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:31.455369 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.455343 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:31.455369 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.455356 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:31.455529 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.455411 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:35.455394228 +0000 UTC m=+10.078767765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:31.455846 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.455814 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:31.455985 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.455867 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:35.455850805 +0000 UTC m=+10.079224340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:31.782300 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:31.782163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:31.782300 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.782292 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:31.782699 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:31.782678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:31.782790 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.782775 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:31.782916 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:31.782899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:31.783103 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:31.783085 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:33.779764 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:33.779727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:33.780210 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:33.779865 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:33.780267 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:33.780253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:33.780382 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:33.780358 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:33.780473 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:33.780436 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:33.780543 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:33.780519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:35.387257 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:35.387217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:35.387675 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.387335 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:35.387675 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.387419 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:43.387390324 +0000 UTC m=+18.010763871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:35.487892 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:35.487860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:35.488092 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:35.487980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:35.488092 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.488053 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:35.488092 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.488066 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:35.488092 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.488077 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:35.488092 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.488089 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:35.488343 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.488127 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:43.488110207 +0000 UTC m=+18.111483751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:35.488343 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.488144 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:43.488135329 +0000 UTC m=+18.111508872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:35.780344 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:35.780274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:35.781892 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:35.781869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:35.782029 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:35.781907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:35.782092 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.782016 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:35.782291 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.782265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:35.782448 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:35.782425 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:37.779416 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:37.779377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:37.779860 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:37.779520 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:37.779965 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:37.779902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:37.780037 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:37.780018 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:37.780196 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:37.780164 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:37.780293 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:37.780247 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:39.779592 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:39.779514 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:39.780052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:39.779515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:39.780052 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:39.779648 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:39.780052 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:39.779732 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:39.780052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:39.779528 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:39.780052 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:39.779818 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:41.779505 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:41.779471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:41.779958 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:41.779471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:41.779958 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:41.779614 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:41.779958 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:41.779479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:41.779958 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:41.779675 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:41.779958 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:41.779741 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:43.447538 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:43.447497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:43.448119 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.447667 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:43.448119 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.447753 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:59.447724308 +0000 UTC m=+34.071097839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:43.548114 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:43.548074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:43.548273 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:43.548150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:43.548273 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.548241 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:43.548357 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.548290 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:43.548357 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.548304 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:59.548288385 +0000 UTC m=+34.171661915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:43.548357 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.548308 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:43.548357 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.548324 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:43.548497 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.548375 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:59.548359818 +0000 UTC m=+34.171733349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:43.779174 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:43.779143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:43.779174 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:43.779162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:43.779388 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.779278 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:43.779446 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.779418 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:43.779509 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:43.779477 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:43.779586 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:43.779564 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:45.780608 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:45.780567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:45.781119 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:45.780646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:45.781119 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:45.780659 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:45.781119 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:45.780763 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:45.781119 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:45.780822 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:45.781119 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:45.780878 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:47.779634 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.779463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:47.780214 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.779463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:47.780214 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:47.779738 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:47.780214 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.779536 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:47.780214 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:47.779813 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:47.780214 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:47.779866 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:47.884153 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.883953 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:36:47.884458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.884437 2579 generic.go:356] "Generic (PLEG): container finished" podID="e19c94f3-ba11-47e2-b4e8-8af69106a41c" containerID="153cee066590cc27fcc96b0de90d0a236302c2320b486d32b163185a1c51c0dd" exitCode=1 Jul 01 22:36:47.884558 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.884504 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"567604d184899f8a04befe563ba2e483b1d09c6d4ea777980149de54feec3747"} Jul 01 22:36:47.884614 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.884591 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"cd9c816e010346d11427f5f4be7bd5cec81a9ebf1a703bcf1679d6826744ec3d"} Jul 01 22:36:47.884654 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.884640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerDied","Data":"153cee066590cc27fcc96b0de90d0a236302c2320b486d32b163185a1c51c0dd"} Jul 01 22:36:47.884705 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.884691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"0b19ec1d718e08a598b22326b0c3866360ddf5cf006c0d7db324e6c52fddaf2f"} Jul 01 22:36:47.885821 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.885798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q4szn" event={"ID":"ca4fa93a-08d5-41fc-ad68-8dc4671b0e79","Type":"ContainerStarted","Data":"c8cbb78362d871c9e8c437b3be959822fdf1404cd2d03ee351ea334561a2a89b"} Jul 01 22:36:47.887222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.887196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmg72" event={"ID":"09e52e9b-d950-4e11-b03a-22e08ce784ae","Type":"ContainerStarted","Data":"998218eecefd2525ef4b51a98e1dc3bccefb15c20dcb908cc8792cc78c71c658"} Jul 01 22:36:47.888678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.888662 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" event={"ID":"12585b4a-528b-4757-b872-d347bbb305ee","Type":"ContainerStarted","Data":"6b35a18f6a8f0ae9f916c2eabdf7205e0d3511fa75f5296064fe0940df464528"} Jul 01 22:36:47.890027 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.890005 2579 generic.go:356] "Generic (PLEG): container finished" podID="6026a364-be43-4ba4-95f6-9efd779d2e1f" containerID="3b0ad143b53246cb2126f8239b285fa6e3205000876aac9832953ca613e7f34b" exitCode=0 Jul 01 22:36:47.890105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.890032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerDied","Data":"3b0ad143b53246cb2126f8239b285fa6e3205000876aac9832953ca613e7f34b"} Jul 01 22:36:47.891544 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.891521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" event={"ID":"c5e75a35-40d9-4c4c-9452-2b20911f2643","Type":"ContainerStarted","Data":"c8a97f9d234bb8ff702b119e095e9851d0492ef19ec0b2f042cc8a235b5c7a3e"} Jul 01 22:36:47.892916 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.892901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j7td8" event={"ID":"9bce97ef-3fee-453a-b1a1-cd2da6b6445e","Type":"ContainerStarted","Data":"27cd92703a4161a0b2b9eb01fe5cfab9e3acf97f39d57a8486fafc3e46f88d27"} Jul 01 22:36:47.894337 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.894308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nm7bc" event={"ID":"edb0714f-f44d-48d5-836c-198f20121771","Type":"ContainerStarted","Data":"25784d81a97cd81df28afc06a957addf62c104398c9dae17f78b6515ae4e1db3"} Jul 01 22:36:47.924714 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.924678 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-227.ec2.internal" podStartSLOduration=20.924664388 podStartE2EDuration="20.924664388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:30.906348972 +0000 UTC m=+5.529722524" watchObservedRunningTime="2026-07-01 22:36:47.924664388 +0000 UTC m=+22.548037941" Jul 01 22:36:47.961385 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.961334 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q4szn" podStartSLOduration=3.256616118 podStartE2EDuration="21.961315686s" totalImagesPullingTime="18.704699568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:47.961021819 +0000 UTC m=+22.584395371" watchObservedRunningTime="2026-07-01 22:36:47.961315686 +0000 UTC m=+22.584689240" Jul 01 22:36:47.992600 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:47.992560 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cmg72" podStartSLOduration=3.230445971 podStartE2EDuration="21.992541388s" totalImagesPullingTime="18.762095417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:47.991982997 +0000 UTC m=+22.615356549" watchObservedRunningTime="2026-07-01 22:36:47.992541388 +0000 UTC m=+22.615914930" Jul 01 22:36:48.008988 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.008945 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nm7bc" podStartSLOduration=8.04765822 podStartE2EDuration="23.008914586s" totalImagesPullingTime="14.961256366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:48.00854929 +0000 UTC m=+22.631922843" watchObservedRunningTime="2026-07-01 22:36:48.008914586 +0000 UTC m=+22.632288139" Jul 01 22:36:48.028112 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.028069 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j7td8" podStartSLOduration=3.328483329 podStartE2EDuration="22.028058079s" totalImagesPullingTime="18.69957475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:48.02720778 +0000 UTC m=+22.650581329" watchObservedRunningTime="2026-07-01 22:36:48.028058079 +0000 UTC m=+22.651431669" Jul 01 22:36:48.048711 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.048672 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7rtnj" podStartSLOduration=3.34514865 podStartE2EDuration="22.048657335s" totalImagesPullingTime="18.703508685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:48.048646249 +0000 UTC m=+22.672019802" watchObservedRunningTime="2026-07-01 22:36:48.048657335 +0000 UTC m=+22.672030886" Jul 01 22:36:48.895536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.895503 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:48.896601 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.896403 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:48.899143 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.899112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cl4s9" event={"ID":"8bed3d9c-abca-4cd4-983d-ad8c577da731","Type":"ContainerStarted","Data":"9c5144b11cf99a6c0eb2d4b20ca4947f125ce78dec73cb3b1cca32eade6e9974"} Jul 01 22:36:48.902138 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.902117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:36:48.902538 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.902513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"aa23f8cd779939ca7b2e7887f9288e14d3d0982bf95157d332837d2de1e68e14"} Jul 01 22:36:48.902622 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.902589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"6eb51e6d3c5b157a6ec908e0313d3dd477c47412931c341c6fe824008bd5edb9"} Jul 01 22:36:48.903350 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.903332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:48.903996 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.903978 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nm7bc" Jul 01 22:36:48.977528 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.977464 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 22:36:48.978718 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:48.978672 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cl4s9" podStartSLOduration=4.270600717 podStartE2EDuration="22.978655403s" totalImagesPullingTime="18.708054686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:48.978596849 +0000 UTC m=+23.601970402" watchObservedRunningTime="2026-07-01 22:36:48.978655403 +0000 UTC m=+23.602028955" Jul 01 22:36:49.781100 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.780929 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T22:36:48.977487051Z","UUID":"de6b9066-c0b1-4936-9d24-a059c162b498","Handler":null,"Name":"","Endpoint":""} Jul 01 22:36:49.782637 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.782614 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 22:36:49.782817 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.782668 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 22:36:49.786153 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.786126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:49.786268 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.786126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:49.786268 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.786245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:49.786268 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:49.786247 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:49.786422 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:49.786341 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:49.786478 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:49.786436 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:49.906810 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:49.906748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" event={"ID":"12585b4a-528b-4757-b872-d347bbb305ee","Type":"ContainerStarted","Data":"e631105be495a95721a148489d97fb347c37a6854c41d5772fed43e0de3326a0"} Jul 01 22:36:50.912865 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:50.912838 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:36:50.913334 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:50.913231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"f772660c7b79587542d6038a29da0976f2f8d786499cd5b464a26283ee53e52c"} Jul 01 22:36:51.778999 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:51.778923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:51.779185 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:51.778945 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:51.779185 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:51.779051 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:51.779185 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:51.779048 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:51.779185 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:51.779171 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:51.779368 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:51.779272 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:52.920360 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.920210 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:36:52.921220 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.920682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"a9c45303eba7d9b6dec9080f7dacd39b54ac834ac5de066e050b89b664764ecf"} Jul 01 22:36:52.921220 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.920966 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:52.921220 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.921155 2579 scope.go:117] "RemoveContainer" containerID="153cee066590cc27fcc96b0de90d0a236302c2320b486d32b163185a1c51c0dd" Jul 01 22:36:52.922889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.922859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" event={"ID":"12585b4a-528b-4757-b872-d347bbb305ee","Type":"ContainerStarted","Data":"5befbe5bb161d4e58de84030cd15221bd0d23489f751e8e14321f3b5e23d7c97"} Jul 01 22:36:52.924632 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.924612 2579 generic.go:356] "Generic (PLEG): container finished" podID="6026a364-be43-4ba4-95f6-9efd779d2e1f" containerID="a281dc282f3b3775012fce732b35752b1d84fff142b04a49a3629b453798e74d" exitCode=0 Jul 01 22:36:52.924725 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.924638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerDied","Data":"a281dc282f3b3775012fce732b35752b1d84fff142b04a49a3629b453798e74d"} Jul 01 22:36:52.937109 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:52.937084 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:53.122172 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.121986 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5874n" podStartSLOduration=5.181155198 podStartE2EDuration="28.121969483s" totalImagesPullingTime="22.940814285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:53.048633558 +0000 UTC m=+27.672007109" watchObservedRunningTime="2026-07-01 22:36:53.121969483 +0000 UTC m=+27.745343035" Jul 01 22:36:53.779757 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.779717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:53.779964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.779724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:53.779964 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:53.779847 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:53.779964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.779724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:53.780099 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:53.779969 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:53.780099 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:53.779983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:53.929969 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.929894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:36:53.930390 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.930301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" event={"ID":"e19c94f3-ba11-47e2-b4e8-8af69106a41c","Type":"ContainerStarted","Data":"9c5d701bd404f195b9d7fc48bd506f88637dbd7bfe43cae83a1ac475b25f43b8"} Jul 01 22:36:53.930480 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.930467 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:53.930684 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.930657 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:53.945504 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.945484 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:36:53.963131 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:53.963091 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" podStartSLOduration=9.190021478 podStartE2EDuration="27.963078974s" totalImagesPullingTime="18.773057496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:53.961327376 +0000 UTC m=+28.584700928" watchObservedRunningTime="2026-07-01 22:36:53.963078974 +0000 UTC m=+28.586452526" Jul 01 22:36:54.934245 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:54.934210 2579 generic.go:356] "Generic (PLEG): container finished" podID="6026a364-be43-4ba4-95f6-9efd779d2e1f" containerID="225cf43e1eca73480658a49fe2d8ae1ca072c53a9c321cd6c81b3e4ae6422462" exitCode=0 Jul 01 22:36:54.934774 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:54.934303 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerDied","Data":"225cf43e1eca73480658a49fe2d8ae1ca072c53a9c321cd6c81b3e4ae6422462"} Jul 01 22:36:55.779954 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:55.779898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:55.780123 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:55.780057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:55.780123 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:55.780068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:55.780123 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:55.780061 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:55.780246 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:55.780166 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:55.780292 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:55.780240 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:56.940064 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:56.940030 2579 generic.go:356] "Generic (PLEG): container finished" podID="6026a364-be43-4ba4-95f6-9efd779d2e1f" containerID="a6eb7b5779eab9cc479dfcb6b937abdd99c6fae4ef9993bdfcebe2a90e4338d8" exitCode=0 Jul 01 22:36:56.940421 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:56.940079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerDied","Data":"a6eb7b5779eab9cc479dfcb6b937abdd99c6fae4ef9993bdfcebe2a90e4338d8"} Jul 01 22:36:57.779016 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:57.778985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:57.779197 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:57.778985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:57.779197 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:57.779102 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:57.779197 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:57.778990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:57.779197 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:57.779183 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:57.779342 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:57.779238 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:59.465373 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.465344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:59.465808 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.465510 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:59.465808 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.465576 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret podName:87cc096e-5f44-4471-bf7e-32d1c1032602 nodeName:}" failed. No retries permitted until 2026-07-01 22:37:31.465557246 +0000 UTC m=+66.088930778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret") pod "global-pull-secret-syncer-pvzbn" (UID: "87cc096e-5f44-4471-bf7e-32d1c1032602") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:59.511554 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.511518 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvzbn"] Jul 01 22:36:59.511773 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.511645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:36:59.511885 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.511791 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:36:59.514740 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.514716 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkh8w"] Jul 01 22:36:59.514858 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.514801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:59.514924 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.514881 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:36:59.526058 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.526031 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4t8t"] Jul 01 22:36:59.526184 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.526134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:59.526257 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.526236 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:36:59.566264 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.566188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:36:59.566264 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:36:59.566259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:36:59.566434 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.566353 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:59.566434 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.566377 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:59.566434 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.566395 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:59.566434 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.566409 2579 projected.go:196] Error preparing data for projected volume kube-api-access-8vp2m for pod openshift-network-diagnostics/network-check-target-t4t8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:59.566434 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.566425 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs podName:8523b2c4-6c90-4eaf-8065-8b151ebe64c1 nodeName:}" failed. No retries permitted until 2026-07-01 22:37:31.566405111 +0000 UTC m=+66.189778658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs") pod "network-metrics-daemon-gkh8w" (UID: "8523b2c4-6c90-4eaf-8065-8b151ebe64c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:59.566665 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:36:59.566445 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m podName:f303bb42-e5c9-47bc-8923-1ae10077c1e9 nodeName:}" failed. No retries permitted until 2026-07-01 22:37:31.566435358 +0000 UTC m=+66.189808888 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vp2m" (UniqueName: "kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m") pod "network-check-target-t4t8t" (UID: "f303bb42-e5c9-47bc-8923-1ae10077c1e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:37:00.779015 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:00.778927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:00.779015 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:00.778969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:37:00.779409 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:00.779045 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:37:00.779409 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:00.779097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:37:00.779409 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:00.779160 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:37:00.779409 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:00.779222 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:37:02.779662 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:02.779627 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:37:02.780086 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:02.779796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:37:02.780086 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:02.779806 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzbn" podUID="87cc096e-5f44-4471-bf7e-32d1c1032602" Jul 01 22:37:02.780086 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:02.779832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:02.780086 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:02.779916 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkh8w" podUID="8523b2c4-6c90-4eaf-8065-8b151ebe64c1" Jul 01 22:37:02.780086 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:02.780017 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4t8t" podUID="f303bb42-e5c9-47bc-8923-1ae10077c1e9" Jul 01 22:37:03.220685 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.220532 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-227.ec2.internal" event="NodeReady" Jul 01 22:37:03.220795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.220784 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 22:37:03.265747 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.265714 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pdhhh"] Jul 01 22:37:03.267490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.267471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.269718 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.269696 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 22:37:03.271429 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.271237 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 22:37:03.271680 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.271652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xzbh\"" Jul 01 22:37:03.272111 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.272092 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-snprw"] Jul 01 22:37:03.273777 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.273751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.276041 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.276006 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 22:37:03.276151 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.276117 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 22:37:03.276273 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.276255 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5qzdt\"" Jul 01 22:37:03.276691 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.276672 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 22:37:03.276691 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.276687 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 22:37:03.280824 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.280664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdhhh"] Jul 01 22:37:03.286983 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.286910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-snprw"] Jul 01 22:37:03.369871 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.369834 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-px26w"] Jul 01 22:37:03.371486 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.371466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.373811 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.373789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 22:37:03.373984 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.373820 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78g8f\"" Jul 01 22:37:03.373984 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.373838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 22:37:03.374074 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.373982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 22:37:03.381208 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.381186 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-px26w"] Jul 01 22:37:03.394383 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba13ad38-1737-497b-b48e-86d657924bc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.394490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba13ad38-1737-497b-b48e-86d657924bc0-crio-socket\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.394490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba13ad38-1737-497b-b48e-86d657924bc0-data-volume\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.394490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba13ad38-1737-497b-b48e-86d657924bc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.394618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31011703-db12-46b0-8530-416afc7ec29d-config-volume\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.394618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j27f\" (UniqueName: \"kubernetes.io/projected/31011703-db12-46b0-8530-416afc7ec29d-kube-api-access-4j27f\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.394618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwh4j\" (UniqueName: \"kubernetes.io/projected/ba13ad38-1737-497b-b48e-86d657924bc0-kube-api-access-bwh4j\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.394618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31011703-db12-46b0-8530-416afc7ec29d-metrics-tls\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.394787 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.394622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31011703-db12-46b0-8530-416afc7ec29d-tmp-dir\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.495358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwh4j\" (UniqueName: \"kubernetes.io/projected/ba13ad38-1737-497b-b48e-86d657924bc0-kube-api-access-bwh4j\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.495358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31011703-db12-46b0-8530-416afc7ec29d-metrics-tls\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.495560 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31011703-db12-46b0-8530-416afc7ec29d-tmp-dir\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.495560 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba13ad38-1737-497b-b48e-86d657924bc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.495560 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba13ad38-1737-497b-b48e-86d657924bc0-crio-socket\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.495560 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ddf595-4e4d-4706-ae97-b5e6042484cb-cert\") pod \"ingress-canary-px26w\" (UID: \"20ddf595-4e4d-4706-ae97-b5e6042484cb\") " pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.495560 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba13ad38-1737-497b-b48e-86d657924bc0-data-volume\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.495560 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba13ad38-1737-497b-b48e-86d657924bc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.495844 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31011703-db12-46b0-8530-416afc7ec29d-config-volume\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.495844 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc82m\" (UniqueName: \"kubernetes.io/projected/20ddf595-4e4d-4706-ae97-b5e6042484cb-kube-api-access-qc82m\") pod \"ingress-canary-px26w\" (UID: \"20ddf595-4e4d-4706-ae97-b5e6042484cb\") " pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.495844 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j27f\" (UniqueName: \"kubernetes.io/projected/31011703-db12-46b0-8530-416afc7ec29d-kube-api-access-4j27f\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.495844 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495641 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba13ad38-1737-497b-b48e-86d657924bc0-crio-socket\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.495844 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.495832 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31011703-db12-46b0-8530-416afc7ec29d-tmp-dir\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.496141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.496121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba13ad38-1737-497b-b48e-86d657924bc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.496202 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.496183 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31011703-db12-46b0-8530-416afc7ec29d-config-volume\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.496239 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.496211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba13ad38-1737-497b-b48e-86d657924bc0-data-volume\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.499402 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.499381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba13ad38-1737-497b-b48e-86d657924bc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.499402 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.499396 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31011703-db12-46b0-8530-416afc7ec29d-metrics-tls\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.507518 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.507500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j27f\" (UniqueName: \"kubernetes.io/projected/31011703-db12-46b0-8530-416afc7ec29d-kube-api-access-4j27f\") pod \"dns-default-pdhhh\" (UID: \"31011703-db12-46b0-8530-416afc7ec29d\") " pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.507606 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.507513 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwh4j\" (UniqueName: \"kubernetes.io/projected/ba13ad38-1737-497b-b48e-86d657924bc0-kube-api-access-bwh4j\") pod \"insights-runtime-extractor-snprw\" (UID: \"ba13ad38-1737-497b-b48e-86d657924bc0\") " pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.577659 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.577638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:03.587739 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.587718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-snprw" Jul 01 22:37:03.596496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.596475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ddf595-4e4d-4706-ae97-b5e6042484cb-cert\") pod \"ingress-canary-px26w\" (UID: \"20ddf595-4e4d-4706-ae97-b5e6042484cb\") " pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.596561 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.596528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc82m\" (UniqueName: \"kubernetes.io/projected/20ddf595-4e4d-4706-ae97-b5e6042484cb-kube-api-access-qc82m\") pod \"ingress-canary-px26w\" (UID: \"20ddf595-4e4d-4706-ae97-b5e6042484cb\") " pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.599646 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.599624 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ddf595-4e4d-4706-ae97-b5e6042484cb-cert\") pod \"ingress-canary-px26w\" (UID: \"20ddf595-4e4d-4706-ae97-b5e6042484cb\") " pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.605105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.605080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc82m\" (UniqueName: \"kubernetes.io/projected/20ddf595-4e4d-4706-ae97-b5e6042484cb-kube-api-access-qc82m\") pod \"ingress-canary-px26w\" (UID: \"20ddf595-4e4d-4706-ae97-b5e6042484cb\") " pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.682588 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.682222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-px26w" Jul 01 22:37:03.729385 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.729343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdhhh"] Jul 01 22:37:03.734045 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.734018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-snprw"] Jul 01 22:37:03.734399 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:03.734355 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31011703_db12_46b0_8530_416afc7ec29d.slice/crio-7e07a2aab63759842b85ace9a5b45180954801f5c2df2c2434499ea1e395ae5d WatchSource:0}: Error finding container 7e07a2aab63759842b85ace9a5b45180954801f5c2df2c2434499ea1e395ae5d: Status 404 returned error can't find the container with id 7e07a2aab63759842b85ace9a5b45180954801f5c2df2c2434499ea1e395ae5d Jul 01 22:37:03.816038 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.816008 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-px26w"] Jul 01 22:37:03.818858 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:03.818829 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ddf595_4e4d_4706_ae97_b5e6042484cb.slice/crio-4eab9a2db4d721d0368db191a33c64e86055c9259a4ccf79a7681eaf6318dfd0 WatchSource:0}: Error finding container 4eab9a2db4d721d0368db191a33c64e86055c9259a4ccf79a7681eaf6318dfd0: Status 404 returned error can't find the container with id 4eab9a2db4d721d0368db191a33c64e86055c9259a4ccf79a7681eaf6318dfd0 Jul 01 22:37:03.957254 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.957154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-px26w" event={"ID":"20ddf595-4e4d-4706-ae97-b5e6042484cb","Type":"ContainerStarted","Data":"4eab9a2db4d721d0368db191a33c64e86055c9259a4ccf79a7681eaf6318dfd0"} Jul 01 22:37:03.959639 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.959614 2579 generic.go:356] "Generic (PLEG): container finished" podID="6026a364-be43-4ba4-95f6-9efd779d2e1f" containerID="7f0091fea5a4d5218c34c9abd632262500c2fd06d8621f47b93095aaef7a050d" exitCode=0 Jul 01 22:37:03.959753 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.959685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerDied","Data":"7f0091fea5a4d5218c34c9abd632262500c2fd06d8621f47b93095aaef7a050d"} Jul 01 22:37:03.960779 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.960759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-snprw" event={"ID":"ba13ad38-1737-497b-b48e-86d657924bc0","Type":"ContainerStarted","Data":"8f76a830863b57b5b0c3970e601e7f8c6d557242a00a4e7f32a45c6f1393373e"} Jul 01 22:37:03.961796 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:03.961772 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdhhh" event={"ID":"31011703-db12-46b0-8530-416afc7ec29d","Type":"ContainerStarted","Data":"7e07a2aab63759842b85ace9a5b45180954801f5c2df2c2434499ea1e395ae5d"} Jul 01 22:37:04.680808 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.679788 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-lgt9c"] Jul 01 22:37:04.683166 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.681961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.685116 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.684652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8gglm\"" Jul 01 22:37:04.685116 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.684957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 22:37:04.689149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.687360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 22:37:04.689149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.687608 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 22:37:04.689149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.687787 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 22:37:04.689149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.688022 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 22:37:04.699738 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.699716 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-lgt9c"] Jul 01 22:37:04.780313 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.779675 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:37:04.780313 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.780007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:04.780580 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.779948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:37:04.782827 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.782803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 22:37:04.783395 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.783170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:37:04.784135 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.783705 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 22:37:04.784135 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.783895 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:37:04.784135 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.783970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hlntg\"" Jul 01 22:37:04.793964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.793508 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bn4bk\"" Jul 01 22:37:04.808347 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.807903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6k4j\" (UniqueName: \"kubernetes.io/projected/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-kube-api-access-c6k4j\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.808347 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.807982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.808347 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.808017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.808347 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.808059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.909477 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.909428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6k4j\" (UniqueName: \"kubernetes.io/projected/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-kube-api-access-c6k4j\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.910003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.909507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.910003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.909543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.910003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.909590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.910574 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.910509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.918624 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.915079 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.918624 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.918116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6k4j\" (UniqueName: \"kubernetes.io/projected/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-kube-api-access-c6k4j\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.918624 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.918550 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c936a78f-eb31-4a5b-b0e4-7b05e5837c06-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-lgt9c\" (UID: \"c936a78f-eb31-4a5b-b0e4-7b05e5837c06\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:04.978003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.977190 2579 generic.go:356] "Generic (PLEG): container finished" podID="6026a364-be43-4ba4-95f6-9efd779d2e1f" containerID="11a1ad41bf0b662dd3ee10fc634ed1b4d2eb311bcce7b77fecd95015969b6a48" exitCode=0 Jul 01 22:37:04.978003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:04.977270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerDied","Data":"11a1ad41bf0b662dd3ee10fc634ed1b4d2eb311bcce7b77fecd95015969b6a48"} Jul 01 22:37:05.006470 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:05.000779 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" Jul 01 22:37:05.207907 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:05.207821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-lgt9c"] Jul 01 22:37:05.212566 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:05.212538 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc936a78f_eb31_4a5b_b0e4_7b05e5837c06.slice/crio-797a083f6e410a2a7316ac151b6bca2f347e92a408cc4f8e9c584d700b7678fe WatchSource:0}: Error finding container 797a083f6e410a2a7316ac151b6bca2f347e92a408cc4f8e9c584d700b7678fe: Status 404 returned error can't find the container with id 797a083f6e410a2a7316ac151b6bca2f347e92a408cc4f8e9c584d700b7678fe Jul 01 22:37:05.981779 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:05.981738 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" event={"ID":"c936a78f-eb31-4a5b-b0e4-7b05e5837c06","Type":"ContainerStarted","Data":"797a083f6e410a2a7316ac151b6bca2f347e92a408cc4f8e9c584d700b7678fe"} Jul 01 22:37:05.985894 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:05.985868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" event={"ID":"6026a364-be43-4ba4-95f6-9efd779d2e1f","Type":"ContainerStarted","Data":"0d747795f05733317fe38242b12763f37d03de2aba199b35e9f0e07f6a224c16"} Jul 01 22:37:06.016054 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:06.016003 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cxgtb" podStartSLOduration=8.75724323 podStartE2EDuration="40.015982842s" totalImagesPullingTime="31.258739612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:06.010556607 +0000 UTC m=+40.633930158" watchObservedRunningTime="2026-07-01 22:37:06.015982842 +0000 UTC m=+40.639356395" Jul 01 22:37:11.000921 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.000825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-px26w" event={"ID":"20ddf595-4e4d-4706-ae97-b5e6042484cb","Type":"ContainerStarted","Data":"573fd51d36cde88844a13df319e22a154582a64f40d9815c37d63d92cc867a4e"} Jul 01 22:37:11.002215 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.002190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-snprw" event={"ID":"ba13ad38-1737-497b-b48e-86d657924bc0","Type":"ContainerStarted","Data":"db78a4cc6ae25951d001ee44e5d2a3b7b38d4062a13178af8b7c1651d317d9db"} Jul 01 22:37:11.003753 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.003734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdhhh" event={"ID":"31011703-db12-46b0-8530-416afc7ec29d","Type":"ContainerStarted","Data":"5cc6b1b6a82d6694368b0efad54c3799ded69c90ae27291308d3a2cffdb3364a"} Jul 01 22:37:11.003847 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.003781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdhhh" event={"ID":"31011703-db12-46b0-8530-416afc7ec29d","Type":"ContainerStarted","Data":"0c1f650fa624ecb1ce38aec1954cf0879ac9cc3da669acc654582886ad06b32c"} Jul 01 22:37:11.003893 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.003876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:11.017144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.017104 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-px26w" podStartSLOduration=1.747505039 podStartE2EDuration="8.017091737s" totalImagesPullingTime="6.269586698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:11.01677562 +0000 UTC m=+45.640149173" watchObservedRunningTime="2026-07-01 22:37:11.017091737 +0000 UTC m=+45.640465289" Jul 01 22:37:11.032827 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:11.032788 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pdhhh" podStartSLOduration=1.68610558 podStartE2EDuration="8.032771478s" totalImagesPullingTime="6.346665898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:11.032557864 +0000 UTC m=+45.655931429" watchObservedRunningTime="2026-07-01 22:37:11.032771478 +0000 UTC m=+45.656145030" Jul 01 22:37:12.014323 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:12.014285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" event={"ID":"c936a78f-eb31-4a5b-b0e4-7b05e5837c06","Type":"ContainerStarted","Data":"d8146de1a75118686232319074da14ec237a12960991800f0404f1c42402ddc9"} Jul 01 22:37:12.014758 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:12.014386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" event={"ID":"c936a78f-eb31-4a5b-b0e4-7b05e5837c06","Type":"ContainerStarted","Data":"4fdbb900934cc24f7ad89d80ffc61c0a31a7a129140e5ddffff0e266baccfb59"} Jul 01 22:37:12.016098 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:12.016066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-snprw" event={"ID":"ba13ad38-1737-497b-b48e-86d657924bc0","Type":"ContainerStarted","Data":"1ba5f71ead5cc65ff2ec25f53fe4ca5c770441cabed222debcd79decd6a9f6d3"} Jul 01 22:37:12.030479 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:12.030433 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-lgt9c" podStartSLOduration=2.196198142 podStartE2EDuration="8.030420575s" totalImagesPullingTime="5.834222433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:12.029170784 +0000 UTC m=+46.652544335" watchObservedRunningTime="2026-07-01 22:37:12.030420575 +0000 UTC m=+46.653794136" Jul 01 22:37:14.033242 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.033203 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw"] Jul 01 22:37:14.094422 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.094366 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw"] Jul 01 22:37:14.094422 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.094426 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-r92n4"] Jul 01 22:37:14.094665 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.094509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.097619 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.097594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nkbtd\"" Jul 01 22:37:14.099619 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.099598 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 22:37:14.105320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.105301 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 22:37:14.126774 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.126735 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-r92n4"] Jul 01 22:37:14.126949 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.126878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.130594 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.130564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 22:37:14.130858 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.130830 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 22:37:14.130997 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.130858 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 22:37:14.131086 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.131006 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lnt75\"" Jul 01 22:37:14.136926 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.136907 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qqchb"] Jul 01 22:37:14.170522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.170487 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.173750 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.173724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 22:37:14.174025 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.174006 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 22:37:14.174143 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.174065 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 22:37:14.174257 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.174237 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bgjw6\"" Jul 01 22:37:14.188980 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.188961 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9r5\" (UniqueName: \"kubernetes.io/projected/f1926b7d-0ba4-4efb-8511-ecf9e075f906-kube-api-access-ds9r5\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.188995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11503719-180e-4a11-8777-5cfc6e00983f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.189095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-wtmp\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.189265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4574dc-691d-4756-8b8d-97efd6549462-metrics-client-ca\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.189265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-root\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a4574dc-691d-4756-8b8d-97efd6549462-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.189496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11503719-180e-4a11-8777-5cfc6e00983f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.189496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-tls\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1926b7d-0ba4-4efb-8511-ecf9e075f906-metrics-client-ca\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.189496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcx4m\" (UniqueName: \"kubernetes.io/projected/2a4574dc-691d-4756-8b8d-97efd6549462-kube-api-access-mcx4m\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.189675 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11503719-180e-4a11-8777-5cfc6e00983f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.189675 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzdrf\" (UniqueName: \"kubernetes.io/projected/11503719-180e-4a11-8777-5cfc6e00983f-kube-api-access-jzdrf\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.189675 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-sys\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189675 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189605 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-textfile\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.189675 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.189622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.290841 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.290760 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4574dc-691d-4756-8b8d-97efd6549462-metrics-client-ca\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.290841 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.290796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-root\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.290841 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.290822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a4574dc-691d-4756-8b8d-97efd6549462-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.291126 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.290879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11503719-180e-4a11-8777-5cfc6e00983f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.291126 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.290903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-tls\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1926b7d-0ba4-4efb-8511-ecf9e075f906-metrics-client-ca\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcx4m\" (UniqueName: \"kubernetes.io/projected/2a4574dc-691d-4756-8b8d-97efd6549462-kube-api-access-mcx4m\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11503719-180e-4a11-8777-5cfc6e00983f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzdrf\" (UniqueName: \"kubernetes.io/projected/11503719-180e-4a11-8777-5cfc6e00983f-kube-api-access-jzdrf\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-sys\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-textfile\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9r5\" (UniqueName: \"kubernetes.io/projected/f1926b7d-0ba4-4efb-8511-ecf9e075f906-kube-api-access-ds9r5\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a4574dc-691d-4756-8b8d-97efd6549462-metrics-client-ca\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.291906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.292086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11503719-180e-4a11-8777-5cfc6e00983f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.292119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-wtmp\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.292258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-root\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.292406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.294877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.292459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.292428 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11503719-180e-4a11-8777-5cfc6e00983f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.293226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a4574dc-691d-4756-8b8d-97efd6549462-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:14.293475 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.293964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:14.295027 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-tls podName:f1926b7d-0ba4-4efb-8511-ecf9e075f906 nodeName:}" failed. No retries permitted until 2026-07-01 22:37:14.795004217 +0000 UTC m=+49.418377760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-tls") pod "node-exporter-qqchb" (UID: "f1926b7d-0ba4-4efb-8511-ecf9e075f906") : secret "node-exporter-tls" not found Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.295286 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.295408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-sys\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.295781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.295423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-wtmp\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.296188 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.296055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1926b7d-0ba4-4efb-8511-ecf9e075f906-metrics-client-ca\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.296242 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.296137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-textfile\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.296797 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.296772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11503719-180e-4a11-8777-5cfc6e00983f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.296914 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.296867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.297604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.297475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.298969 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.298890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11503719-180e-4a11-8777-5cfc6e00983f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.299876 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.299833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a4574dc-691d-4756-8b8d-97efd6549462-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.301754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.301700 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcx4m\" (UniqueName: \"kubernetes.io/projected/2a4574dc-691d-4756-8b8d-97efd6549462-kube-api-access-mcx4m\") pod \"kube-state-metrics-845b954455-r92n4\" (UID: \"2a4574dc-691d-4756-8b8d-97efd6549462\") " pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.302023 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.302003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9r5\" (UniqueName: \"kubernetes.io/projected/f1926b7d-0ba4-4efb-8511-ecf9e075f906-kube-api-access-ds9r5\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.302302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.302285 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzdrf\" (UniqueName: \"kubernetes.io/projected/11503719-180e-4a11-8777-5cfc6e00983f-kube-api-access-jzdrf\") pod \"openshift-state-metrics-57f99c8b49-drvfw\" (UID: \"11503719-180e-4a11-8777-5cfc6e00983f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.406769 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.406726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" Jul 01 22:37:14.437227 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.437193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" Jul 01 22:37:14.750859 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.750822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-r92n4"] Jul 01 22:37:14.754473 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:14.754444 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4574dc_691d_4756_8b8d_97efd6549462.slice/crio-fdd7f85dac5fd445589d4c04657cb968aa058d088cb4b23b2d184dafe1b62c19 WatchSource:0}: Error finding container fdd7f85dac5fd445589d4c04657cb968aa058d088cb4b23b2d184dafe1b62c19: Status 404 returned error can't find the container with id fdd7f85dac5fd445589d4c04657cb968aa058d088cb4b23b2d184dafe1b62c19 Jul 01 22:37:14.764638 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.764612 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw"] Jul 01 22:37:14.767071 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:14.767047 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11503719_180e_4a11_8777_5cfc6e00983f.slice/crio-8b67bd6da33a20fafd7aac4f7287ac8da1d42a925e0aa765e9317c86a97e9145 WatchSource:0}: Error finding container 8b67bd6da33a20fafd7aac4f7287ac8da1d42a925e0aa765e9317c86a97e9145: Status 404 returned error can't find the container with id 8b67bd6da33a20fafd7aac4f7287ac8da1d42a925e0aa765e9317c86a97e9145 Jul 01 22:37:14.798552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.798317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-tls\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:14.800753 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:14.800733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1926b7d-0ba4-4efb-8511-ecf9e075f906-node-exporter-tls\") pod \"node-exporter-qqchb\" (UID: \"f1926b7d-0ba4-4efb-8511-ecf9e075f906\") " pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:15.027024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.026926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" event={"ID":"2a4574dc-691d-4756-8b8d-97efd6549462","Type":"ContainerStarted","Data":"fdd7f85dac5fd445589d4c04657cb968aa058d088cb4b23b2d184dafe1b62c19"} Jul 01 22:37:15.028559 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.028536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" event={"ID":"11503719-180e-4a11-8777-5cfc6e00983f","Type":"ContainerStarted","Data":"014656e1f8b4ee1d9b497dd0622b141f2e80f519c77e5525bace6ac7f8b2bcca"} Jul 01 22:37:15.028653 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.028587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" event={"ID":"11503719-180e-4a11-8777-5cfc6e00983f","Type":"ContainerStarted","Data":"8b67bd6da33a20fafd7aac4f7287ac8da1d42a925e0aa765e9317c86a97e9145"} Jul 01 22:37:15.080812 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.080794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qqchb" Jul 01 22:37:15.087926 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.087905 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:37:15.115511 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:15.115177 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1926b7d_0ba4_4efb_8511_ecf9e075f906.slice/crio-d4b60bf2972c12615764e4846ff8a495d82c985a1034ec695246e36fab0826c2 WatchSource:0}: Error finding container d4b60bf2972c12615764e4846ff8a495d82c985a1034ec695246e36fab0826c2: Status 404 returned error can't find the container with id d4b60bf2972c12615764e4846ff8a495d82c985a1034ec695246e36fab0826c2 Jul 01 22:37:15.128482 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.128461 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:37:15.128627 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.128613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.131423 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131403 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 22:37:15.131516 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 22:37:15.131516 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131491 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hdmdl\"" Jul 01 22:37:15.131669 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 22:37:15.131669 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131552 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 22:37:15.131669 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131607 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 22:37:15.131849 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131751 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 22:37:15.131849 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131751 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 22:37:15.131975 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 22:37:15.131975 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.131872 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 22:37:15.201587 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-config-volume\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201605 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-web-config\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.201754 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.202031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-config-out\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.202031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.202031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.202031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.202031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.201906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dklmp\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-kube-api-access-dklmp\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.302910 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.302807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.302910 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.302865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.302910 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.302891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.302910 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.302909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.302954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-config-out\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.302983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:15.303070 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dklmp\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-kube-api-access-dklmp\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:37:15.303145 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls podName:848b9112-8356-4c6a-82cc-af38a742598a nodeName:}" failed. No retries permitted until 2026-07-01 22:37:15.803125171 +0000 UTC m=+50.426498702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "848b9112-8356-4c6a-82cc-af38a742598a") : secret "alertmanager-main-tls" not found Jul 01 22:37:15.303217 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-config-volume\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303592 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303592 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303592 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-web-config\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.303592 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.303380 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.304116 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.304090 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.304222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.304140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.306350 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.306306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.306589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.306564 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.306770 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.306685 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.306947 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.306910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-config-out\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.307143 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.307124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.307337 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.307313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-web-config\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.308489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.308459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-config-volume\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.308774 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.308760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.314219 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.314198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklmp\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-kube-api-access-dklmp\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.808895 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.808859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:15.814198 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:15.813470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:16.034622 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:16.034586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" event={"ID":"11503719-180e-4a11-8777-5cfc6e00983f","Type":"ContainerStarted","Data":"fd4bdc0a5c82063d923b8e17b8b5c7eee7e61494e72c28680aad2a16b7374f12"} Jul 01 22:37:16.035823 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:16.035791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqchb" event={"ID":"f1926b7d-0ba4-4efb-8511-ecf9e075f906","Type":"ContainerStarted","Data":"d4b60bf2972c12615764e4846ff8a495d82c985a1034ec695246e36fab0826c2"} Jul 01 22:37:16.037246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:16.037217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:37:16.038068 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:16.038047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-snprw" event={"ID":"ba13ad38-1737-497b-b48e-86d657924bc0","Type":"ContainerStarted","Data":"3eb808f6c079436f475f5bff94b3926cb6e4119d60f7ad9d11572f3d3a6f5222"} Jul 01 22:37:16.062149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:16.062079 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-snprw" podStartSLOduration=1.982627728 podStartE2EDuration="13.062064337s" totalImagesPullingTime="11.079436609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:37:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:16.060415375 +0000 UTC m=+50.683788927" watchObservedRunningTime="2026-07-01 22:37:16.062064337 +0000 UTC m=+50.685437889" Jul 01 22:37:17.238483 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.238456 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-865b7c964b-b4vdq"] Jul 01 22:37:17.262962 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.262926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.270032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.269458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 22:37:17.270032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.269712 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 22:37:17.270032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.269824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nwrhm\"" Jul 01 22:37:17.270032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.269894 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 22:37:17.270032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.269957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-655856hbfl5us\"" Jul 01 22:37:17.270372 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.270325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 22:37:17.274833 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.274814 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 22:37:17.282643 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.282595 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865b7c964b-b4vdq"] Jul 01 22:37:17.288058 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.287917 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:37:17.293760 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:17.293727 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848b9112_8356_4c6a_82cc_af38a742598a.slice/crio-d1ee00ade81bf108f15ee8a07a57ddd239eda65bd2d74880b5260c3e7fe91361 WatchSource:0}: Error finding container d1ee00ade81bf108f15ee8a07a57ddd239eda65bd2d74880b5260c3e7fe91361: Status 404 returned error can't find the container with id d1ee00ade81bf108f15ee8a07a57ddd239eda65bd2d74880b5260c3e7fe91361 Jul 01 22:37:17.322947 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.322842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.322947 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.322889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.322947 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.322908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqcc\" (UniqueName: \"kubernetes.io/projected/5f29056e-c37b-4f40-b208-f9bbfa8105a5-kube-api-access-5cqcc\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.323144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.322969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-grpc-tls\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.323144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.323030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-tls\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.323144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.323081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.323144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.323127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.323348 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.323166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f29056e-c37b-4f40-b208-f9bbfa8105a5-metrics-client-ca\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424451 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-grpc-tls\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-tls\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424709 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424799 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424799 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f29056e-c37b-4f40-b208-f9bbfa8105a5-metrics-client-ca\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424959 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424959 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.424959 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.424912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqcc\" (UniqueName: \"kubernetes.io/projected/5f29056e-c37b-4f40-b208-f9bbfa8105a5-kube-api-access-5cqcc\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.425834 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.425784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f29056e-c37b-4f40-b208-f9bbfa8105a5-metrics-client-ca\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.427331 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.427304 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.427331 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.427321 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.427436 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.427316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-grpc-tls\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.427551 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.427529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.427551 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.427544 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-tls\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.427875 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.427857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f29056e-c37b-4f40-b208-f9bbfa8105a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.441220 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.441172 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqcc\" (UniqueName: \"kubernetes.io/projected/5f29056e-c37b-4f40-b208-f9bbfa8105a5-kube-api-access-5cqcc\") pod \"thanos-querier-865b7c964b-b4vdq\" (UID: \"5f29056e-c37b-4f40-b208-f9bbfa8105a5\") " pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.574237 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.574199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:17.727468 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:17.727374 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865b7c964b-b4vdq"] Jul 01 22:37:17.731099 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:17.731075 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f29056e_c37b_4f40_b208_f9bbfa8105a5.slice/crio-e07885d77dfc447292ec5ae7fed9c11107b51632d1d14b512aa4ca1a77492ef8 WatchSource:0}: Error finding container e07885d77dfc447292ec5ae7fed9c11107b51632d1d14b512aa4ca1a77492ef8: Status 404 returned error can't find the container with id e07885d77dfc447292ec5ae7fed9c11107b51632d1d14b512aa4ca1a77492ef8 Jul 01 22:37:18.047132 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.047047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"e07885d77dfc447292ec5ae7fed9c11107b51632d1d14b512aa4ca1a77492ef8"} Jul 01 22:37:18.049391 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.049359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" event={"ID":"11503719-180e-4a11-8777-5cfc6e00983f","Type":"ContainerStarted","Data":"6250f966a1cdca98d9b9d1fee2cff74e2cc95e16f9e7707bacb8e4501013e8e1"} Jul 01 22:37:18.054345 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.054022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" event={"ID":"2a4574dc-691d-4756-8b8d-97efd6549462","Type":"ContainerStarted","Data":"a08bc16e65ca7160fea0a6121de5ad0c4edc0354c0eb24b51fdd889e169c2468"} Jul 01 22:37:18.054345 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.054075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" event={"ID":"2a4574dc-691d-4756-8b8d-97efd6549462","Type":"ContainerStarted","Data":"6e4bc077fd7612be5083b337378cc142e5eed0558821dbcd0837494f2facf970"} Jul 01 22:37:18.054345 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.054115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" event={"ID":"2a4574dc-691d-4756-8b8d-97efd6549462","Type":"ContainerStarted","Data":"2232994c3bbf478b3ed351ee857391700b4d0e92fb49fc07602fad7d3d700ee8"} Jul 01 22:37:18.055835 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.055813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"d1ee00ade81bf108f15ee8a07a57ddd239eda65bd2d74880b5260c3e7fe91361"} Jul 01 22:37:18.057298 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.057278 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1926b7d-0ba4-4efb-8511-ecf9e075f906" containerID="ad0d1b768b66abdb5cd71f786165f7fc36f96efa8711c292db66372bbb74d94e" exitCode=0 Jul 01 22:37:18.057367 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.057308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqchb" event={"ID":"f1926b7d-0ba4-4efb-8511-ecf9e075f906","Type":"ContainerDied","Data":"ad0d1b768b66abdb5cd71f786165f7fc36f96efa8711c292db66372bbb74d94e"} Jul 01 22:37:18.068296 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.068251 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-drvfw" podStartSLOduration=2.1154223229999998 podStartE2EDuration="4.06823724s" totalImagesPullingTime="1.952814917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:18.067045706 +0000 UTC m=+52.690419278" watchObservedRunningTime="2026-07-01 22:37:18.06823724 +0000 UTC m=+52.691610791" Jul 01 22:37:18.100895 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.100847 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-r92n4" podStartSLOduration=1.735430746 podStartE2EDuration="4.10082834s" totalImagesPullingTime="2.365397594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:18.099965852 +0000 UTC m=+52.723339406" watchObservedRunningTime="2026-07-01 22:37:18.10082834 +0000 UTC m=+52.724201892" Jul 01 22:37:18.438065 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.436922 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-665ff8b76d-trcns"] Jul 01 22:37:18.464062 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.464031 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-665ff8b76d-trcns"] Jul 01 22:37:18.464223 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.464166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.466718 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.466694 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 22:37:18.466859 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.466817 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j7gxq\"" Jul 01 22:37:18.466859 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.466817 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 22:37:18.466859 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.466694 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 22:37:18.467147 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.467129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 22:37:18.467305 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.467288 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9a3lep8l4vp0q\"" Jul 01 22:37:18.537537 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-secret-metrics-server-client-certs\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.537710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6df78\" (UniqueName: \"kubernetes.io/projected/2755383e-e361-4d65-b96b-afc92f0b1bbc-kube-api-access-6df78\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.537710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2755383e-e361-4d65-b96b-afc92f0b1bbc-metrics-server-audit-profiles\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.537710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-secret-metrics-server-tls\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.537887 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2755383e-e361-4d65-b96b-afc92f0b1bbc-audit-log\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.537887 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2755383e-e361-4d65-b96b-afc92f0b1bbc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.537887 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.537856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-client-ca-bundle\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638313 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2755383e-e361-4d65-b96b-afc92f0b1bbc-audit-log\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2755383e-e361-4d65-b96b-afc92f0b1bbc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-client-ca-bundle\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-secret-metrics-server-client-certs\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6df78\" (UniqueName: \"kubernetes.io/projected/2755383e-e361-4d65-b96b-afc92f0b1bbc-kube-api-access-6df78\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638660 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2755383e-e361-4d65-b96b-afc92f0b1bbc-metrics-server-audit-profiles\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638660 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-secret-metrics-server-tls\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.638738 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.638677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2755383e-e361-4d65-b96b-afc92f0b1bbc-audit-log\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.639174 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.639125 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2755383e-e361-4d65-b96b-afc92f0b1bbc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.639557 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.639537 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2755383e-e361-4d65-b96b-afc92f0b1bbc-metrics-server-audit-profiles\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.641191 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.641166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-client-ca-bundle\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.641327 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.641310 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-secret-metrics-server-client-certs\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.641440 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.641424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2755383e-e361-4d65-b96b-afc92f0b1bbc-secret-metrics-server-tls\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.646580 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.646552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6df78\" (UniqueName: \"kubernetes.io/projected/2755383e-e361-4d65-b96b-afc92f0b1bbc-kube-api-access-6df78\") pod \"metrics-server-665ff8b76d-trcns\" (UID: \"2755383e-e361-4d65-b96b-afc92f0b1bbc\") " pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.776788 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.776747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:18.817190 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.817157 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-d8t77"] Jul 01 22:37:18.840907 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.840881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-d8t77"] Jul 01 22:37:18.841056 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.841013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:18.843550 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.843309 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 22:37:18.843663 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.843597 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-l4zt2\"" Jul 01 22:37:18.927552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.927472 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-665ff8b76d-trcns"] Jul 01 22:37:18.941555 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.941531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qw62\" (UniqueName: \"kubernetes.io/projected/e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820-kube-api-access-2qw62\") pod \"monitoring-plugin-cd8656b8-d8t77\" (UID: \"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:18.941685 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:18.941585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-d8t77\" (UID: \"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:18.995060 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:18.995030 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2755383e_e361_4d65_b96b_afc92f0b1bbc.slice/crio-b7b06994d7905163561d967ae94fc6c81c2d6f5f10f835e337c5a02e70ea54a9 WatchSource:0}: Error finding container b7b06994d7905163561d967ae94fc6c81c2d6f5f10f835e337c5a02e70ea54a9: Status 404 returned error can't find the container with id b7b06994d7905163561d967ae94fc6c81c2d6f5f10f835e337c5a02e70ea54a9 Jul 01 22:37:19.046770 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.046743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qw62\" (UniqueName: \"kubernetes.io/projected/e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820-kube-api-access-2qw62\") pod \"monitoring-plugin-cd8656b8-d8t77\" (UID: \"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:19.046905 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.046822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-d8t77\" (UID: \"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:19.048984 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.048963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-d8t77\" (UID: \"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:19.063511 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.063480 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqchb" event={"ID":"f1926b7d-0ba4-4efb-8511-ecf9e075f906","Type":"ContainerStarted","Data":"998f83aaaaec247068cf36dd593744318e153bbf831446980fbe69590f7231cb"} Jul 01 22:37:19.063636 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.063592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqchb" event={"ID":"f1926b7d-0ba4-4efb-8511-ecf9e075f906","Type":"ContainerStarted","Data":"bcd4bbcec7f44ef8b3510a9c26990bac4ab704f482bbe645293a45bc331d18d0"} Jul 01 22:37:19.064829 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.064804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" event={"ID":"2755383e-e361-4d65-b96b-afc92f0b1bbc","Type":"ContainerStarted","Data":"b7b06994d7905163561d967ae94fc6c81c2d6f5f10f835e337c5a02e70ea54a9"} Jul 01 22:37:19.078216 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.078198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qw62\" (UniqueName: \"kubernetes.io/projected/e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820-kube-api-access-2qw62\") pod \"monitoring-plugin-cd8656b8-d8t77\" (UID: \"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:19.123436 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.123386 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qqchb" podStartSLOduration=3.003914754 podStartE2EDuration="5.123364413s" totalImagesPullingTime="2.000371417s" totalInitContainerRuntime="119.078242ms" isStatefulPod=true podCreationTimestamp="2026-07-01 22:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:19.119146225 +0000 UTC m=+53.742519776" watchObservedRunningTime="2026-07-01 22:37:19.123364413 +0000 UTC m=+53.746737972" Jul 01 22:37:19.154796 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.154773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:19.320810 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.320779 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-d8t77"] Jul 01 22:37:19.323583 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:19.323555 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a1e6eb_5aaa_49bb_8f8b_7b90df2d8820.slice/crio-08d73550e5e4a320052189116674cf206eba196a98bb5d92399848174a522d2e WatchSource:0}: Error finding container 08d73550e5e4a320052189116674cf206eba196a98bb5d92399848174a522d2e: Status 404 returned error can't find the container with id 08d73550e5e4a320052189116674cf206eba196a98bb5d92399848174a522d2e Jul 01 22:37:19.441304 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.441213 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6549c76bc9-clp7r"] Jul 01 22:37:19.457425 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.457393 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.460964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.460781 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 22:37:19.460964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.460804 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 22:37:19.460964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.460816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 22:37:19.460964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.460831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hgfff\"" Jul 01 22:37:19.460964 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.460889 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6549c76bc9-clp7r"] Jul 01 22:37:19.461302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.461159 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 22:37:19.461302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.461197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 22:37:19.466898 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.466606 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 22:37:19.528225 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.528195 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-v5c82"] Jul 01 22:37:19.541493 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.541468 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:19.543808 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.543778 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-v5c82"] Jul 01 22:37:19.544174 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.544130 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 22:37:19.544266 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.544226 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 22:37:19.544343 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.544140 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ts55s\"" Jul 01 22:37:19.552015 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.551987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-secret-telemeter-client\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552124 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552124 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552251 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-telemeter-client-tls\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-serving-certs-ca-bundle\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm5ww\" (UniqueName: \"kubernetes.io/projected/8d140503-e82c-44f8-aa6e-a8a4de24fca5-kube-api-access-lm5ww\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552397 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-federate-client-tls\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.552397 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.552339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-metrics-client-ca\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-secret-telemeter-client\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653248 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653248 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653248 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-telemeter-client-tls\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653248 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df579\" (UniqueName: \"kubernetes.io/projected/ec8ed306-9fa0-4ed3-a432-d5341092f236-kube-api-access-df579\") pod \"downloads-5499b6fb8f-v5c82\" (UID: \"ec8ed306-9fa0-4ed3-a432-d5341092f236\") " pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:19.653248 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-serving-certs-ca-bundle\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653515 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm5ww\" (UniqueName: \"kubernetes.io/projected/8d140503-e82c-44f8-aa6e-a8a4de24fca5-kube-api-access-lm5ww\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653515 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-federate-client-tls\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.653617 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.653552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-metrics-client-ca\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.654035 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.654003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-serving-certs-ca-bundle\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.654431 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.654403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-metrics-client-ca\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.654546 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.654443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d140503-e82c-44f8-aa6e-a8a4de24fca5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.656142 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.656118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-secret-telemeter-client\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.656277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.656199 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-telemeter-client-tls\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.656341 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.656300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.656341 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.656314 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8d140503-e82c-44f8-aa6e-a8a4de24fca5-federate-client-tls\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.662832 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.662809 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm5ww\" (UniqueName: \"kubernetes.io/projected/8d140503-e82c-44f8-aa6e-a8a4de24fca5-kube-api-access-lm5ww\") pod \"telemeter-client-6549c76bc9-clp7r\" (UID: \"8d140503-e82c-44f8-aa6e-a8a4de24fca5\") " pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.755299 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.755210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df579\" (UniqueName: \"kubernetes.io/projected/ec8ed306-9fa0-4ed3-a432-d5341092f236-kube-api-access-df579\") pod \"downloads-5499b6fb8f-v5c82\" (UID: \"ec8ed306-9fa0-4ed3-a432-d5341092f236\") " pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:19.764897 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.764873 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df579\" (UniqueName: \"kubernetes.io/projected/ec8ed306-9fa0-4ed3-a432-d5341092f236-kube-api-access-df579\") pod \"downloads-5499b6fb8f-v5c82\" (UID: \"ec8ed306-9fa0-4ed3-a432-d5341092f236\") " pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:19.769670 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.769640 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" Jul 01 22:37:19.853296 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:19.853259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:20.082962 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.082875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" event={"ID":"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820","Type":"ContainerStarted","Data":"08d73550e5e4a320052189116674cf206eba196a98bb5d92399848174a522d2e"} Jul 01 22:37:20.085234 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.085204 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c" exitCode=0 Jul 01 22:37:20.085352 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.085292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c"} Jul 01 22:37:20.103120 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.103053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-v5c82"] Jul 01 22:37:20.109079 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:20.108961 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8ed306_9fa0_4ed3_a432_d5341092f236.slice/crio-c439bf915d313a37a8f2986a91c9979dd0725740e325f3770e17161877c41df8 WatchSource:0}: Error finding container c439bf915d313a37a8f2986a91c9979dd0725740e325f3770e17161877c41df8: Status 404 returned error can't find the container with id c439bf915d313a37a8f2986a91c9979dd0725740e325f3770e17161877c41df8 Jul 01 22:37:20.129646 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.129614 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6549c76bc9-clp7r"] Jul 01 22:37:20.134770 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:20.134737 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d140503_e82c_44f8_aa6e_a8a4de24fca5.slice/crio-b4e945a0e3558ca40a24e295ce7248bb4eeb69df02cb9efce12db718732e90ca WatchSource:0}: Error finding container b4e945a0e3558ca40a24e295ce7248bb4eeb69df02cb9efce12db718732e90ca: Status 404 returned error can't find the container with id b4e945a0e3558ca40a24e295ce7248bb4eeb69df02cb9efce12db718732e90ca Jul 01 22:37:20.287274 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.287236 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:37:20.303585 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.303513 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.310081 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310048 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 22:37:20.310081 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310048 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 22:37:20.310367 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 22:37:20.310367 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 22:37:20.310489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310405 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 22:37:20.310489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310437 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aotdks65s2b6c\"" Jul 01 22:37:20.310618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310499 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 22:37:20.310618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310548 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 22:37:20.310618 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310576 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 22:37:20.310755 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310580 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vsdc2\"" Jul 01 22:37:20.310755 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310633 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 22:37:20.310755 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310661 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 22:37:20.310755 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.310688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 22:37:20.312364 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.312349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 22:37:20.315728 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.315707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 22:37:20.318035 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.318014 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 22:37:20.327413 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.327379 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:37:20.363289 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.363261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.363589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.363568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.363729 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.363716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.363846 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.363832 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.363972 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.363959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364135 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364270 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-config\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364378 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364378 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364378 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x8jk\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-kube-api-access-8x8jk\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364828 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364828 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364828 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.364828 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.364634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-config\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.466999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x8jk\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-kube-api-access-8x8jk\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.467222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.467817 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.468088 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.468876 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.468708 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.474155 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.469274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.474155 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.470976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.474155 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.472173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.474155 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.472290 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.474830 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.474771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.479716 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.479655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485154 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.483525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485154 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.483987 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485154 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.484365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-config\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485154 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.484758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485436 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.485180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485436 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.485218 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485629 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.485607 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485867 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.485784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.485867 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.485429 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.486131 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.486111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.486554 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.486534 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x8jk\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-kube-api-access-8x8jk\") pod \"prometheus-k8s-0\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.615511 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.615489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:20.837246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:20.837214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:37:20.841445 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:20.841405 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea686ee_3723_46ac_8f73_5379fb47c89b.slice/crio-7fc96b895a6a0b88b8f7d1fab5f30b6c109bc98fb4d9f962891c2485794ea4e4 WatchSource:0}: Error finding container 7fc96b895a6a0b88b8f7d1fab5f30b6c109bc98fb4d9f962891c2485794ea4e4: Status 404 returned error can't find the container with id 7fc96b895a6a0b88b8f7d1fab5f30b6c109bc98fb4d9f962891c2485794ea4e4 Jul 01 22:37:21.019125 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.019048 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pdhhh" Jul 01 22:37:21.096503 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.095182 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf" exitCode=0 Jul 01 22:37:21.096503 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.095291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf"} Jul 01 22:37:21.096503 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.095398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"7fc96b895a6a0b88b8f7d1fab5f30b6c109bc98fb4d9f962891c2485794ea4e4"} Jul 01 22:37:21.101854 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.101794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-v5c82" event={"ID":"ec8ed306-9fa0-4ed3-a432-d5341092f236","Type":"ContainerStarted","Data":"c439bf915d313a37a8f2986a91c9979dd0725740e325f3770e17161877c41df8"} Jul 01 22:37:21.103454 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.103380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" event={"ID":"8d140503-e82c-44f8-aa6e-a8a4de24fca5","Type":"ContainerStarted","Data":"b4e945a0e3558ca40a24e295ce7248bb4eeb69df02cb9efce12db718732e90ca"} Jul 01 22:37:21.106873 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.106848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"63f214508bdfb2e55c07f826c08c26b4dcc576b66783e85bc3ec39f4e69d4b42"} Jul 01 22:37:21.106980 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.106919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"2ecb6dfab8efd0c12612b4532e33e6a313e3d1e3e570bcb3d06f825f02804232"} Jul 01 22:37:21.107048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:21.106991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"dc4bab6e2fbb5aee781e959de37b607ce1f1631e6049f16d24a35e969d4ec5e5"} Jul 01 22:37:25.128154 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.128111 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" event={"ID":"8d140503-e82c-44f8-aa6e-a8a4de24fca5","Type":"ContainerStarted","Data":"b8bb8d05f6c188b13c18653867b3f87a8f68d6679660725ba1a6e74bb4d4f9de"} Jul 01 22:37:25.128642 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.128215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" event={"ID":"8d140503-e82c-44f8-aa6e-a8a4de24fca5","Type":"ContainerStarted","Data":"39c170fa7d03b14e59fd38151e30cbc676b33765d7823f00572509f20640d1ed"} Jul 01 22:37:25.128642 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.128244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" event={"ID":"8d140503-e82c-44f8-aa6e-a8a4de24fca5","Type":"ContainerStarted","Data":"da6715cb48234cfd093c0276f091943d003448a7ca46ddda46c2969d6f34c5ef"} Jul 01 22:37:25.132344 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.132312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"c48b58af2b2987c13be4cfc82e63b5fdd458082bd99cb5b31192dc389b956819"} Jul 01 22:37:25.132509 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.132391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"82642aacd92d36e2536bc7fde807c16ae30c150c3922b2f6d1c31dabf622d9b3"} Jul 01 22:37:25.132509 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.132429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" event={"ID":"5f29056e-c37b-4f40-b208-f9bbfa8105a5","Type":"ContainerStarted","Data":"9b785d76073cab1de6e405df9dbf6cd270f30f5bcedf430dae8c084dcbd818e5"} Jul 01 22:37:25.133493 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.133467 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:25.136029 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.135675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" event={"ID":"e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820","Type":"ContainerStarted","Data":"cb716ad29973f860ca9f00238984e5c542c264218f51a3fee85cccf50d253a02"} Jul 01 22:37:25.136029 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.135846 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:25.140958 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.140854 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" Jul 01 22:37:25.141892 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.141872 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" Jul 01 22:37:25.142604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.142564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714"} Jul 01 22:37:25.142702 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.142627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821"} Jul 01 22:37:25.142702 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.142670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b"} Jul 01 22:37:25.142814 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.142713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f"} Jul 01 22:37:25.142814 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.142754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960"} Jul 01 22:37:25.142814 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.142795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerStarted","Data":"aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81"} Jul 01 22:37:25.145464 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.145067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" event={"ID":"2755383e-e361-4d65-b96b-afc92f0b1bbc","Type":"ContainerStarted","Data":"b1374ba1daf4e466e7a35c58477f003ff3c7ab29ffe2fe7a2f8ade7792ee0b56"} Jul 01 22:37:25.152448 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.152037 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6549c76bc9-clp7r" podStartSLOduration=2.062395073 podStartE2EDuration="6.152021419s" totalImagesPullingTime="4.089626346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:25.151104452 +0000 UTC m=+59.774478005" watchObservedRunningTime="2026-07-01 22:37:25.152021419 +0000 UTC m=+59.775394968" Jul 01 22:37:25.179412 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.179353 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.282388964 podStartE2EDuration="10.179329333s" totalImagesPullingTime="5.875723707s" totalInitContainerRuntime="21.216662ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:25.177512012 +0000 UTC m=+59.800885567" watchObservedRunningTime="2026-07-01 22:37:25.179329333 +0000 UTC m=+59.802702900" Jul 01 22:37:25.206759 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.206503 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-865b7c964b-b4vdq" podStartSLOduration=2.194556526 podStartE2EDuration="8.206478072s" totalImagesPullingTime="6.011921546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:25.20532806 +0000 UTC m=+59.828701613" watchObservedRunningTime="2026-07-01 22:37:25.206478072 +0000 UTC m=+59.829851621" Jul 01 22:37:25.228030 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.227967 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" podStartSLOduration=2.029080443 podStartE2EDuration="7.227946203s" totalImagesPullingTime="5.19886576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:25.225204044 +0000 UTC m=+59.848577625" watchObservedRunningTime="2026-07-01 22:37:25.227946203 +0000 UTC m=+59.851319746" Jul 01 22:37:25.243894 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.243791 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-d8t77" podStartSLOduration=2.34715691 podStartE2EDuration="7.243761442s" totalImagesPullingTime="4.896604532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:25.242952214 +0000 UTC m=+59.866325761" watchObservedRunningTime="2026-07-01 22:37:25.243761442 +0000 UTC m=+59.867134995" Jul 01 22:37:25.956751 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:25.956515 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bj769" Jul 01 22:37:27.159624 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.159579 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd"} Jul 01 22:37:27.160067 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.159741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370"} Jul 01 22:37:27.160067 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.159794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491"} Jul 01 22:37:27.160067 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.159840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad"} Jul 01 22:37:27.160067 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.159882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da"} Jul 01 22:37:27.160067 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.159921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerStarted","Data":"5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254"} Jul 01 22:37:27.217657 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:27.217091 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8956492900000002 podStartE2EDuration="7.21706835s" totalImagesPullingTime="5.29459055s" totalInitContainerRuntime="26.82851ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:27.215328864 +0000 UTC m=+61.838702416" watchObservedRunningTime="2026-07-01 22:37:27.21706835 +0000 UTC m=+61.840441962" Jul 01 22:37:30.616085 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:30.616046 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:31.500122 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.500090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:37:31.502862 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.502837 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:37:31.512674 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.512642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87cc096e-5f44-4471-bf7e-32d1c1032602-original-pull-secret\") pod \"global-pull-secret-syncer-pvzbn\" (UID: \"87cc096e-5f44-4471-bf7e-32d1c1032602\") " pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:37:31.601366 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.601334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:37:31.601557 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.601384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:31.605056 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.605025 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 22:37:31.605195 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.605088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:37:31.614882 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.614857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8523b2c4-6c90-4eaf-8065-8b151ebe64c1-metrics-certs\") pod \"network-metrics-daemon-gkh8w\" (UID: \"8523b2c4-6c90-4eaf-8065-8b151ebe64c1\") " pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:37:31.615126 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.615108 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 22:37:31.625784 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.625763 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vp2m\" (UniqueName: \"kubernetes.io/projected/f303bb42-e5c9-47bc-8923-1ae10077c1e9-kube-api-access-8vp2m\") pod \"network-check-target-t4t8t\" (UID: \"f303bb42-e5c9-47bc-8923-1ae10077c1e9\") " pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:31.808959 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.808870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzbn" Jul 01 22:37:31.824915 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.824886 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bn4bk\"" Jul 01 22:37:31.830180 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.830159 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hlntg\"" Jul 01 22:37:31.833168 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.833143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:31.837914 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:31.837888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkh8w" Jul 01 22:37:38.647714 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:38.647674 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4t8t"] Jul 01 22:37:38.651060 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:38.651029 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf303bb42_e5c9_47bc_8923_1ae10077c1e9.slice/crio-f2475be2706bc12bb72d7f126cbca532c74617d8b92da5b83c12afcecbf4eebb WatchSource:0}: Error finding container f2475be2706bc12bb72d7f126cbca532c74617d8b92da5b83c12afcecbf4eebb: Status 404 returned error can't find the container with id f2475be2706bc12bb72d7f126cbca532c74617d8b92da5b83c12afcecbf4eebb Jul 01 22:37:38.777744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:38.777673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:38.777744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:38.777738 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:38.878694 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:38.878664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvzbn"] Jul 01 22:37:38.880403 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:38.880370 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkh8w"] Jul 01 22:37:38.882148 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:38.882123 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cc096e_5f44_4471_bf7e_32d1c1032602.slice/crio-ffe218319531d68769d42ff9e26e4877155974e2af7f399ba4361a366199da82 WatchSource:0}: Error finding container ffe218319531d68769d42ff9e26e4877155974e2af7f399ba4361a366199da82: Status 404 returned error can't find the container with id ffe218319531d68769d42ff9e26e4877155974e2af7f399ba4361a366199da82 Jul 01 22:37:38.883450 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:37:38.883421 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8523b2c4_6c90_4eaf_8065_8b151ebe64c1.slice/crio-78f14d9c7b666b9b33eaa27fd9bf37f0d8a93b5ae792164b606088761e7b1125 WatchSource:0}: Error finding container 78f14d9c7b666b9b33eaa27fd9bf37f0d8a93b5ae792164b606088761e7b1125: Status 404 returned error can't find the container with id 78f14d9c7b666b9b33eaa27fd9bf37f0d8a93b5ae792164b606088761e7b1125 Jul 01 22:37:39.217388 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.217355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-v5c82" event={"ID":"ec8ed306-9fa0-4ed3-a432-d5341092f236","Type":"ContainerStarted","Data":"3603cf5d3f4df93164f8b611b335d2e5837287fa2f7dba7980ec8f000a79d3c3"} Jul 01 22:37:39.218168 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.218106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:39.219645 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.219607 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkh8w" event={"ID":"8523b2c4-6c90-4eaf-8065-8b151ebe64c1","Type":"ContainerStarted","Data":"78f14d9c7b666b9b33eaa27fd9bf37f0d8a93b5ae792164b606088761e7b1125"} Jul 01 22:37:39.221347 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.221287 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4t8t" event={"ID":"f303bb42-e5c9-47bc-8923-1ae10077c1e9","Type":"ContainerStarted","Data":"f2475be2706bc12bb72d7f126cbca532c74617d8b92da5b83c12afcecbf4eebb"} Jul 01 22:37:39.222951 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.222890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvzbn" event={"ID":"87cc096e-5f44-4471-bf7e-32d1c1032602","Type":"ContainerStarted","Data":"ffe218319531d68769d42ff9e26e4877155974e2af7f399ba4361a366199da82"} Jul 01 22:37:39.225992 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.225972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-v5c82" Jul 01 22:37:39.237103 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:39.236972 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-v5c82" podStartSLOduration=1.428372774 podStartE2EDuration="20.236954275s" totalImagesPullingTime="18.808581501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:39.235411392 +0000 UTC m=+73.858784957" watchObservedRunningTime="2026-07-01 22:37:39.236954275 +0000 UTC m=+73.860327823" Jul 01 22:37:41.241232 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:41.241150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkh8w" event={"ID":"8523b2c4-6c90-4eaf-8065-8b151ebe64c1","Type":"ContainerStarted","Data":"b9b70683664a49004cf72234431b0879fa25d1f5535ea56d268e802ac687b9e0"} Jul 01 22:37:42.249781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:42.249723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkh8w" event={"ID":"8523b2c4-6c90-4eaf-8065-8b151ebe64c1","Type":"ContainerStarted","Data":"4a6d241defed44a15c5790024d8d66622b8b58520539b897dbe743a9be28594c"} Jul 01 22:37:45.274811 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:45.274774 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4t8t" event={"ID":"f303bb42-e5c9-47bc-8923-1ae10077c1e9","Type":"ContainerStarted","Data":"3f7924c17160ceebce99be2d412ec9128447f1339947758b3efe7dd97bab41c3"} Jul 01 22:37:46.281020 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:46.280978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvzbn" event={"ID":"87cc096e-5f44-4471-bf7e-32d1c1032602","Type":"ContainerStarted","Data":"520b40a27099cd0057cd29de412b9a77e72157bc84d4121e95d528c61f300eee"} Jul 01 22:37:46.281458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:46.281265 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:37:46.295994 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:46.295919 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gkh8w" podStartSLOduration=78.314779436 podStartE2EDuration="1m20.29590313s" totalImagesPullingTime="1.981123694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:42.27039003 +0000 UTC m=+76.893763584" watchObservedRunningTime="2026-07-01 22:37:46.29590313 +0000 UTC m=+80.919276729" Jul 01 22:37:46.311411 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:46.311355 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t4t8t" podStartSLOduration=73.825254375 podStartE2EDuration="1m20.311335103s" totalImagesPullingTime="6.486080728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:46.310602305 +0000 UTC m=+80.933975859" watchObservedRunningTime="2026-07-01 22:37:46.311335103 +0000 UTC m=+80.934708658" Jul 01 22:37:46.312228 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:46.312187 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pvzbn" podStartSLOduration=74.044195646 podStartE2EDuration="1m20.312174509s" totalImagesPullingTime="6.267978863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:46.295139286 +0000 UTC m=+80.918512838" watchObservedRunningTime="2026-07-01 22:37:46.312174509 +0000 UTC m=+80.935548062" Jul 01 22:37:49.016266 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:49.016155 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:49.068021 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:49.067995 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:49.326855 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:49.326834 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:37:58.783267 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:58.783235 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:37:58.786994 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:37:58.786970 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-665ff8b76d-trcns" Jul 01 22:38:03.787148 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787120 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:38:03.787543 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787376 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="alertmanager" containerID="cri-o://aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81" gracePeriod=120 Jul 01 22:38:03.787543 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787452 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-metric" containerID="cri-o://bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821" gracePeriod=120 Jul 01 22:38:03.787543 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787488 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="prom-label-proxy" containerID="cri-o://de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714" gracePeriod=120 Jul 01 22:38:03.787543 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787512 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-web" containerID="cri-o://9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f" gracePeriod=120 Jul 01 22:38:03.787760 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787529 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="config-reloader" containerID="cri-o://c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960" gracePeriod=120 Jul 01 22:38:03.787760 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:03.787592 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy" containerID="cri-o://9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b" gracePeriod=120 Jul 01 22:38:04.379332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379303 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714" exitCode=0 Jul 01 22:38:04.379332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379328 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821" exitCode=0 Jul 01 22:38:04.379332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379337 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b" exitCode=0 Jul 01 22:38:04.379332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379343 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960" exitCode=0 Jul 01 22:38:04.379611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379349 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81" exitCode=0 Jul 01 22:38:04.379611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714"} Jul 01 22:38:04.379611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379433 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821"} Jul 01 22:38:04.379611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b"} Jul 01 22:38:04.379611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960"} Jul 01 22:38:04.379611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:04.379506 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81"} Jul 01 22:38:05.176063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.176003 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.327184 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327148 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-main-db\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327196 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-config-out\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327228 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327250 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-cluster-tls-config\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327330 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-web-config\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327358 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327386 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-web\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327424 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-tls-assets\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327473 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-trusted-ca-bundle\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327501 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dklmp\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-kube-api-access-dklmp\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327518 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327531 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327583 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-metrics-client-ca\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.327644 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327617 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-config-volume\") pod \"848b9112-8356-4c6a-82cc-af38a742598a\" (UID: \"848b9112-8356-4c6a-82cc-af38a742598a\") " Jul 01 22:38:05.328070 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.327911 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-main-db\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.330495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.330413 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-config-out" (OuterVolumeSpecName: "config-out") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:38:05.330495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.330435 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.330689 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.330567 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-config-volume" (OuterVolumeSpecName: "config-volume") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.330805 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.330732 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:05.330901 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.330879 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:05.331042 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.330996 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:38:05.331111 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.331024 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.331333 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.331302 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.332681 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.332655 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.332757 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.332704 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-kube-api-access-dklmp" (OuterVolumeSpecName: "kube-api-access-dklmp") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "kube-api-access-dklmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:38:05.335212 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.335134 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.341716 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.341692 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-web-config" (OuterVolumeSpecName: "web-config") pod "848b9112-8356-4c6a-82cc-af38a742598a" (UID: "848b9112-8356-4c6a-82cc-af38a742598a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:05.386432 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.386404 2579 generic.go:356] "Generic (PLEG): container finished" podID="848b9112-8356-4c6a-82cc-af38a742598a" containerID="9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f" exitCode=0 Jul 01 22:38:05.386567 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.386463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f"} Jul 01 22:38:05.386567 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.386499 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.386567 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.386516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"848b9112-8356-4c6a-82cc-af38a742598a","Type":"ContainerDied","Data":"d1ee00ade81bf108f15ee8a07a57ddd239eda65bd2d74880b5260c3e7fe91361"} Jul 01 22:38:05.386567 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.386550 2579 scope.go:117] "RemoveContainer" containerID="de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714" Jul 01 22:38:05.394709 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.394695 2579 scope.go:117] "RemoveContainer" containerID="bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821" Jul 01 22:38:05.406395 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.406374 2579 scope.go:117] "RemoveContainer" containerID="9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b" Jul 01 22:38:05.414148 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.414124 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:38:05.414636 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.414619 2579 scope.go:117] "RemoveContainer" containerID="9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f" Jul 01 22:38:05.417972 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.417953 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:38:05.423420 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.423401 2579 scope.go:117] "RemoveContainer" containerID="c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960" Jul 01 22:38:05.429095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429037 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/848b9112-8356-4c6a-82cc-af38a742598a-config-out\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429057 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-main-tls\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429068 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-cluster-tls-config\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429096 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-web-config\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429106 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429116 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429125 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-tls-assets\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429134 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429142 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dklmp\" (UniqueName: \"kubernetes.io/projected/848b9112-8356-4c6a-82cc-af38a742598a-kube-api-access-dklmp\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429151 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429159 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848b9112-8356-4c6a-82cc-af38a742598a-metrics-client-ca\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.429340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.429167 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/848b9112-8356-4c6a-82cc-af38a742598a-config-volume\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:05.430707 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.430680 2579 scope.go:117] "RemoveContainer" containerID="aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81" Jul 01 22:38:05.437365 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.437346 2579 scope.go:117] "RemoveContainer" containerID="e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c" Jul 01 22:38:05.444204 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.444184 2579 scope.go:117] "RemoveContainer" containerID="de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714" Jul 01 22:38:05.444466 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.444437 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714\": container with ID starting with de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714 not found: ID does not exist" containerID="de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714" Jul 01 22:38:05.444539 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.444478 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714"} err="failed to get container status \"de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714\": rpc error: code = NotFound desc = could not find container \"de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714\": container with ID starting with de5be38edb044f8aba199513057f71d4dc5573df328bc1010eb6e403d8adc714 not found: ID does not exist" Jul 01 22:38:05.444539 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.444519 2579 scope.go:117] "RemoveContainer" containerID="bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821" Jul 01 22:38:05.444765 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.444747 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821\": container with ID starting with bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821 not found: ID does not exist" containerID="bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821" Jul 01 22:38:05.444808 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.444772 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821"} err="failed to get container status \"bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821\": rpc error: code = NotFound desc = could not find container \"bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821\": container with ID starting with bc8df59d35e91ff2b1e970ace2021be61d130ee0c25c65de81c6df42d5ee1821 not found: ID does not exist" Jul 01 22:38:05.444808 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.444789 2579 scope.go:117] "RemoveContainer" containerID="9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b" Jul 01 22:38:05.445023 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.445008 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b\": container with ID starting with 9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b not found: ID does not exist" containerID="9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b" Jul 01 22:38:05.445073 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445028 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b"} err="failed to get container status \"9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b\": rpc error: code = NotFound desc = could not find container \"9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b\": container with ID starting with 9ec134fb81188d388ac60399e8f4a5adef3a53e047c80dbb224c1c62d31ee20b not found: ID does not exist" Jul 01 22:38:05.445073 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445042 2579 scope.go:117] "RemoveContainer" containerID="9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f" Jul 01 22:38:05.445240 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.445221 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f\": container with ID starting with 9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f not found: ID does not exist" containerID="9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f" Jul 01 22:38:05.445277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445247 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f"} err="failed to get container status \"9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f\": rpc error: code = NotFound desc = could not find container \"9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f\": container with ID starting with 9e3a4e49c5900d2cffb17c02eb34e690ec87b1eb8d5e5d4f832b343fd394a63f not found: ID does not exist" Jul 01 22:38:05.445277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445262 2579 scope.go:117] "RemoveContainer" containerID="c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960" Jul 01 22:38:05.445437 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.445424 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960\": container with ID starting with c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960 not found: ID does not exist" containerID="c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960" Jul 01 22:38:05.445471 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445441 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960"} err="failed to get container status \"c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960\": rpc error: code = NotFound desc = could not find container \"c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960\": container with ID starting with c79c8bb544dba321ed7141dda116f2784fe9765b32c646a7e233c08241364960 not found: ID does not exist" Jul 01 22:38:05.445471 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445454 2579 scope.go:117] "RemoveContainer" containerID="aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81" Jul 01 22:38:05.445651 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.445637 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81\": container with ID starting with aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81 not found: ID does not exist" containerID="aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81" Jul 01 22:38:05.445688 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445652 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81"} err="failed to get container status \"aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81\": rpc error: code = NotFound desc = could not find container \"aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81\": container with ID starting with aecdb8b7bba8f71d301d545e0903077f9d74f771dd6009163ff7d56a38e01c81 not found: ID does not exist" Jul 01 22:38:05.445688 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445662 2579 scope.go:117] "RemoveContainer" containerID="e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c" Jul 01 22:38:05.445812 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:05.445798 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c\": container with ID starting with e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c not found: ID does not exist" containerID="e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c" Jul 01 22:38:05.445849 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.445813 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c"} err="failed to get container status \"e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c\": rpc error: code = NotFound desc = could not find container \"e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c\": container with ID starting with e323077ff400f7e5efff9d038ee7a4ff95b5dcf5c8455ca8a3ab65053fac7c0c not found: ID does not exist" Jul 01 22:38:05.448649 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.448629 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:38:05.449052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449036 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449054 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449067 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="config-reloader" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449072 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="config-reloader" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449079 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="init-config-reloader" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449086 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="init-config-reloader" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449092 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-web" Jul 01 22:38:05.449105 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449098 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-web" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449109 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="alertmanager" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449115 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="alertmanager" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449123 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="prom-label-proxy" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449128 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="prom-label-proxy" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449135 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-metric" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449140 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-metric" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449198 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="prom-label-proxy" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449205 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-web" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449212 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy-metric" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449220 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="alertmanager" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449227 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="kube-rbac-proxy" Jul 01 22:38:05.449306 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.449232 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b9112-8356-4c6a-82cc-af38a742598a" containerName="config-reloader" Jul 01 22:38:05.469214 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.469178 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:38:05.469374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.469347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.471735 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.471716 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 22:38:05.471967 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.471867 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 22:38:05.471967 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.471920 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 22:38:05.471967 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.471961 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hdmdl\"" Jul 01 22:38:05.472170 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.472034 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 22:38:05.472170 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.472093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 22:38:05.472303 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.472170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 22:38:05.472303 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.472205 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 22:38:05.472303 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.472208 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 22:38:05.477578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.477560 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 22:38:05.631558 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-config-out\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-web-config\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631944 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9k8\" (UniqueName: \"kubernetes.io/projected/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-kube-api-access-9c9k8\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631944 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631944 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631944 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631944 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.631944 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.631844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732506 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732506 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732686 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-config-out\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732686 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732686 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732686 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732874 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-web-config\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732874 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9k8\" (UniqueName: \"kubernetes.io/projected/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-kube-api-access-9c9k8\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.732874 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.733063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.733063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.733063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.732993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.733063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.733011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.733063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.733021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.733316 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.733172 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.734466 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.733850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.735717 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.735717 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-config-out\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.735906 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735747 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.735906 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735770 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.735906 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.736091 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.736091 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.735905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-web-config\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.736638 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.736619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.737399 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.737384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.741607 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.741581 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9k8\" (UniqueName: \"kubernetes.io/projected/55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f-kube-api-access-9c9k8\") pod \"alertmanager-main-0\" (UID: \"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.779526 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.779503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:38:05.785457 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.785434 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="848b9112-8356-4c6a-82cc-af38a742598a" path="/var/lib/kubelet/pods/848b9112-8356-4c6a-82cc-af38a742598a/volumes" Jul 01 22:38:05.950106 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:05.949959 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:38:05.953742 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:38:05.953718 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a2d94a_ab8f_4500_9d22_ee7fafa1ba1f.slice/crio-2a93ffee587baea7836f4b2f66b741ad8b9c2209d807934d575042d36d80f39e WatchSource:0}: Error finding container 2a93ffee587baea7836f4b2f66b741ad8b9c2209d807934d575042d36d80f39e: Status 404 returned error can't find the container with id 2a93ffee587baea7836f4b2f66b741ad8b9c2209d807934d575042d36d80f39e Jul 01 22:38:06.393417 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:06.393386 2579 generic.go:356] "Generic (PLEG): container finished" podID="55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f" containerID="0c951574426fe4d40cfc40d5a40bcd2e09426689c676f9755b28016f37d0db2d" exitCode=0 Jul 01 22:38:06.393782 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:06.393440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerDied","Data":"0c951574426fe4d40cfc40d5a40bcd2e09426689c676f9755b28016f37d0db2d"} Jul 01 22:38:06.393782 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:06.393492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"2a93ffee587baea7836f4b2f66b741ad8b9c2209d807934d575042d36d80f39e"} Jul 01 22:38:07.400711 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.400677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"0e2e10b6dcffe97153e80d0a98d7dbc511447d7d3264d5abbfc2e761f2b585fe"} Jul 01 22:38:07.401246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.400788 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"eb392829f15e1c30496878bb3316ad459c901419613dea41cc1e620943676cd6"} Jul 01 22:38:07.401246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.400833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"acfeb6c43c4ac3554bc81ad1493720af7a5f81b2bfa4f0b6d849956c929a7689"} Jul 01 22:38:07.401246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.400879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"a1e63a1393b315d2de93dc34736f1f43c60c4988ab9aa7b6ad12c8145d523f13"} Jul 01 22:38:07.401246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.400916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"542412ae20e3414515254def476cb8e84669bc4660653333619369df002874f2"} Jul 01 22:38:07.401246 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.400982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f","Type":"ContainerStarted","Data":"f1cf901b1fda850cb6e5915f9f499179b54be8e45ae198b39f1a0428806bed6f"} Jul 01 22:38:07.428514 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:07.428467 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.413362824 podStartE2EDuration="2.428447621s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.084797ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:38:07.428021583 +0000 UTC m=+102.051395140" watchObservedRunningTime="2026-07-01 22:38:07.428447621 +0000 UTC m=+102.051821174" Jul 01 22:38:08.030328 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030290 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:38:08.030620 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030590 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="prometheus" containerID="cri-o://5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254" gracePeriod=600 Jul 01 22:38:08.030698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030596 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy" containerID="cri-o://2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370" gracePeriod=600 Jul 01 22:38:08.030698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030640 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="thanos-sidecar" containerID="cri-o://c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad" gracePeriod=600 Jul 01 22:38:08.030698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030645 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="config-reloader" containerID="cri-o://f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da" gracePeriod=600 Jul 01 22:38:08.030915 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030691 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-web" containerID="cri-o://76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491" gracePeriod=600 Jul 01 22:38:08.030915 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.030640 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd" gracePeriod=600 Jul 01 22:38:08.409623 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409594 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd" exitCode=0 Jul 01 22:38:08.409623 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409619 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370" exitCode=0 Jul 01 22:38:08.409623 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409625 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad" exitCode=0 Jul 01 22:38:08.409623 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409630 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da" exitCode=0 Jul 01 22:38:08.410095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409635 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254" exitCode=0 Jul 01 22:38:08.410095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd"} Jul 01 22:38:08.410095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370"} Jul 01 22:38:08.410095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad"} Jul 01 22:38:08.410095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da"} Jul 01 22:38:08.410095 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:08.409794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254"} Jul 01 22:38:09.314704 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.314638 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.416997 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.416961 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerID="76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491" exitCode=0 Jul 01 22:38:09.417426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.417031 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.417426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.417035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491"} Jul 01 22:38:09.417426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.417123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ea686ee-3723-46ac-8f73-5379fb47c89b","Type":"ContainerDied","Data":"7fc96b895a6a0b88b8f7d1fab5f30b6c109bc98fb4d9f962891c2485794ea4e4"} Jul 01 22:38:09.417426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.417175 2579 scope.go:117] "RemoveContainer" containerID="7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd" Jul 01 22:38:09.426611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.426182 2579 scope.go:117] "RemoveContainer" containerID="2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370" Jul 01 22:38:09.433843 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.433826 2579 scope.go:117] "RemoveContainer" containerID="76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491" Jul 01 22:38:09.440366 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.440350 2579 scope.go:117] "RemoveContainer" containerID="c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad" Jul 01 22:38:09.446639 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.446624 2579 scope.go:117] "RemoveContainer" containerID="f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da" Jul 01 22:38:09.454258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.454243 2579 scope.go:117] "RemoveContainer" containerID="5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254" Jul 01 22:38:09.465995 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.465883 2579 scope.go:117] "RemoveContainer" containerID="c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf" Jul 01 22:38:09.466727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.466390 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.466917 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.466888 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-trusted-ca-bundle\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.467058 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.467044 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x8jk\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-kube-api-access-8x8jk\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.467173 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.467159 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-serving-certs-ca-bundle\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.467290 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.467278 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-kubelet-serving-ca-bundle\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.468142 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.468121 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-2\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.468435 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.468372 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-metrics-client-ca\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.468589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.468575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-config-out\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.468805 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.468791 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-1\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469175 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.468929 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-thanos-prometheus-http-client-file\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469313 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.469300 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-grpc-tls\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469445 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.469434 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-tls-assets\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469553 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.469542 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-web-config\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.469667 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-config\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469784 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.469772 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-tls\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.469898 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.469887 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-kube-rbac-proxy\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.470035 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.470016 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-db\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.470176 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.470161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.470290 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.470278 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-metrics-client-certs\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.470423 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.470407 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-0\") pod \"1ea686ee-3723-46ac-8f73-5379fb47c89b\" (UID: \"1ea686ee-3723-46ac-8f73-5379fb47c89b\") " Jul 01 22:38:09.471090 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.471040 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.478450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.472242 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.478450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.472540 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.478450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.477378 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.478450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.477985 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.478450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.478299 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.479258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.479232 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:09.479768 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.479732 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-kube-api-access-8x8jk" (OuterVolumeSpecName: "kube-api-access-8x8jk") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "kube-api-access-8x8jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:38:09.479891 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.479872 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:38:09.480372 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.480322 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.481193 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.481155 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:38:09.481421 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.481391 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.481830 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.481705 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.482021 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.481998 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.482157 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.482092 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.482255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.482233 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-config-out" (OuterVolumeSpecName: "config-out") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:38:09.482308 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.482242 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.482425 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.482404 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-config" (OuterVolumeSpecName: "config") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.482488 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.482460 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.490493 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.490473 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-web-config" (OuterVolumeSpecName: "web-config") pod "1ea686ee-3723-46ac-8f73-5379fb47c89b" (UID: "1ea686ee-3723-46ac-8f73-5379fb47c89b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:09.495450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.495435 2579 scope.go:117] "RemoveContainer" containerID="7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd" Jul 01 22:38:09.495761 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.495740 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd\": container with ID starting with 7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd not found: ID does not exist" containerID="7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd" Jul 01 22:38:09.495830 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.495770 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd"} err="failed to get container status \"7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd\": rpc error: code = NotFound desc = could not find container \"7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd\": container with ID starting with 7c349dc14a1c1636b888ab02028aa05c15a2489bdc4d1e3c47f83e7569fa3ebd not found: ID does not exist" Jul 01 22:38:09.495830 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.495789 2579 scope.go:117] "RemoveContainer" containerID="2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370" Jul 01 22:38:09.496096 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.496080 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370\": container with ID starting with 2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370 not found: ID does not exist" containerID="2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370" Jul 01 22:38:09.496148 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496102 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370"} err="failed to get container status \"2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370\": rpc error: code = NotFound desc = could not find container \"2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370\": container with ID starting with 2e47dd50fc898c86acb432a2065f8aa72e6ca38f2a6ca8a536ccb300b053b370 not found: ID does not exist" Jul 01 22:38:09.496148 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496117 2579 scope.go:117] "RemoveContainer" containerID="76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491" Jul 01 22:38:09.496351 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.496334 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491\": container with ID starting with 76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491 not found: ID does not exist" containerID="76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491" Jul 01 22:38:09.496393 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496356 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491"} err="failed to get container status \"76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491\": rpc error: code = NotFound desc = could not find container \"76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491\": container with ID starting with 76f1ebd55336b5ed8ca1519efb5c0d0f7f99eeabf41b679e3cc7fef76e546491 not found: ID does not exist" Jul 01 22:38:09.496393 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496371 2579 scope.go:117] "RemoveContainer" containerID="c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad" Jul 01 22:38:09.496587 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.496574 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad\": container with ID starting with c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad not found: ID does not exist" containerID="c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad" Jul 01 22:38:09.496629 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496590 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad"} err="failed to get container status \"c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad\": rpc error: code = NotFound desc = could not find container \"c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad\": container with ID starting with c1c1fe9a929505568d954273f2e81652a2c6e73bebc74f8070595b887fd096ad not found: ID does not exist" Jul 01 22:38:09.496629 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496602 2579 scope.go:117] "RemoveContainer" containerID="f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da" Jul 01 22:38:09.496820 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.496807 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da\": container with ID starting with f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da not found: ID does not exist" containerID="f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da" Jul 01 22:38:09.497019 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496823 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da"} err="failed to get container status \"f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da\": rpc error: code = NotFound desc = could not find container \"f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da\": container with ID starting with f6a4a5d228d73a482335b00c81a181d11db8e4a84440d032e973e575bde004da not found: ID does not exist" Jul 01 22:38:09.497019 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.496835 2579 scope.go:117] "RemoveContainer" containerID="5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254" Jul 01 22:38:09.497107 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.497051 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254\": container with ID starting with 5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254 not found: ID does not exist" containerID="5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254" Jul 01 22:38:09.497107 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.497070 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254"} err="failed to get container status \"5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254\": rpc error: code = NotFound desc = could not find container \"5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254\": container with ID starting with 5d7ebe381c0c505bf0e2892f624b67dab801e5f115ecebedf270872c1af4a254 not found: ID does not exist" Jul 01 22:38:09.497107 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.497084 2579 scope.go:117] "RemoveContainer" containerID="c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf" Jul 01 22:38:09.497322 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:38:09.497300 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf\": container with ID starting with c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf not found: ID does not exist" containerID="c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf" Jul 01 22:38:09.497371 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.497330 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf"} err="failed to get container status \"c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf\": rpc error: code = NotFound desc = could not find container \"c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf\": container with ID starting with c9bd9aeb4427f6e5fe8619297bdb3c2c8b1e0f9306b22f56a94d0c997bcd4acf not found: ID does not exist" Jul 01 22:38:09.571845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571767 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.571845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571797 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.571845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571807 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.571845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571826 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x8jk\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-kube-api-access-8x8jk\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.571845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571835 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.571845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571844 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571853 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571862 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-configmap-metrics-client-ca\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571871 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-config-out\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571879 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571887 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571896 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-grpc-tls\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571904 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea686ee-3723-46ac-8f73-5379fb47c89b-tls-assets\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571911 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-web-config\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571919 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-config\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571926 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571947 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-kube-rbac-proxy\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571957 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea686ee-3723-46ac-8f73-5379fb47c89b-prometheus-k8s-db\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571966 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.572141 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.571974 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ea686ee-3723-46ac-8f73-5379fb47c89b-secret-metrics-client-certs\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:38:09.741890 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.741861 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:38:09.749726 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.749698 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:38:09.776493 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776464 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:38:09.776799 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776787 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776801 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776812 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="config-reloader" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776817 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="config-reloader" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776824 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-thanos" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776831 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-thanos" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776839 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="init-config-reloader" Jul 01 22:38:09.776845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776846 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="init-config-reloader" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776852 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="thanos-sidecar" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776857 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="thanos-sidecar" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776865 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-web" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776870 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-web" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776882 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="prometheus" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776887 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="prometheus" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776966 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="prometheus" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776984 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776991 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="thanos-sidecar" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.776997 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-thanos" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.777002 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="kube-rbac-proxy-web" Jul 01 22:38:09.777093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.777007 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" containerName="config-reloader" Jul 01 22:38:09.799687 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.799617 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:38:09.799899 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.799871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.802744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.802547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 22:38:09.802744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.802570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 22:38:09.802744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.802643 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 22:38:09.802744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.802548 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 22:38:09.803032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.802759 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 22:38:09.803032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.802794 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 22:38:09.803032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803004 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 22:38:09.803331 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803177 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 22:38:09.803331 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803315 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 22:38:09.803506 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803420 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 22:38:09.803506 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803434 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vsdc2\"" Jul 01 22:38:09.803506 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803454 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 22:38:09.803838 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.803793 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 22:38:09.805450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.805229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aotdks65s2b6c\"" Jul 01 22:38:09.806616 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.806593 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 22:38:09.808276 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.808252 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea686ee-3723-46ac-8f73-5379fb47c89b" path="/var/lib/kubelet/pods/1ea686ee-3723-46ac-8f73-5379fb47c89b/volumes" Jul 01 22:38:09.809294 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.809274 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 22:38:09.976522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976522 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/29ee3090-32c7-40fe-b458-c77533bf8e34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.976801 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-web-config\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.976924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-config\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977084 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djs4g\" (UniqueName: \"kubernetes.io/projected/29ee3090-32c7-40fe-b458-c77533bf8e34-kube-api-access-djs4g\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/29ee3090-32c7-40fe-b458-c77533bf8e34-config-out\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:09.977319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:09.977265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.077800 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-web-config\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.077961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-config\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djs4g\" (UniqueName: \"kubernetes.io/projected/29ee3090-32c7-40fe-b458-c77533bf8e34-kube-api-access-djs4g\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/29ee3090-32c7-40fe-b458-c77533bf8e34-config-out\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.078589 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/29ee3090-32c7-40fe-b458-c77533bf8e34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.079122 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078588 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.079122 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.078684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081076 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.080958 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/29ee3090-32c7-40fe-b458-c77533bf8e34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081076 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.080995 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.081165 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.081213 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-web-config\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081532 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.081509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081677 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.081657 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.081746 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.081719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.082557 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.082196 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.082557 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.082306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.082557 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.082401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.082557 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.082431 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.082813 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.082651 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.082965 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.082927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ee3090-32c7-40fe-b458-c77533bf8e34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.083426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.083408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.083696 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.083672 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/29ee3090-32c7-40fe-b458-c77533bf8e34-config-out\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.083756 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.083741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-config\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.084396 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.084379 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/29ee3090-32c7-40fe-b458-c77533bf8e34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.090348 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.090331 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djs4g\" (UniqueName: \"kubernetes.io/projected/29ee3090-32c7-40fe-b458-c77533bf8e34-kube-api-access-djs4g\") pod \"prometheus-k8s-0\" (UID: \"29ee3090-32c7-40fe-b458-c77533bf8e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.112353 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.112333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:10.288330 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.288303 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:38:10.290407 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:38:10.290377 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ee3090_32c7_40fe_b458_c77533bf8e34.slice/crio-0faa9f3546f76843acd33c5f654452a0bdafe1b9bffae44d4c143e563086afbd WatchSource:0}: Error finding container 0faa9f3546f76843acd33c5f654452a0bdafe1b9bffae44d4c143e563086afbd: Status 404 returned error can't find the container with id 0faa9f3546f76843acd33c5f654452a0bdafe1b9bffae44d4c143e563086afbd Jul 01 22:38:10.425231 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.425187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"4b2ee03a8af3c72b56b52be161a8f3a2097fe6c9dcda8e344568e357b15ae97d"} Jul 01 22:38:10.425664 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:10.425267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"0faa9f3546f76843acd33c5f654452a0bdafe1b9bffae44d4c143e563086afbd"} Jul 01 22:38:11.430609 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:11.430573 2579 generic.go:356] "Generic (PLEG): container finished" podID="29ee3090-32c7-40fe-b458-c77533bf8e34" containerID="4b2ee03a8af3c72b56b52be161a8f3a2097fe6c9dcda8e344568e357b15ae97d" exitCode=0 Jul 01 22:38:11.431048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:11.430661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerDied","Data":"4b2ee03a8af3c72b56b52be161a8f3a2097fe6c9dcda8e344568e357b15ae97d"} Jul 01 22:38:12.438176 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.438143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"ca9288a93ddda5b05018910af4409aa74136502edea4f82d0d5975469ff8a3f0"} Jul 01 22:38:12.438604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.438205 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"909b69f9aa0ae2696080b46d449fd39ddee69d977a4c57179155a1c6d3e9c2e4"} Jul 01 22:38:12.438604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.438229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"e2df7d56336ff19242ad642e51585c65c95ac180e77452885fdfd57767620a30"} Jul 01 22:38:12.438604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.438267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"fe79fa0b7eb3fc20bbf77edb8170dfd666e27f8311023d25931490cd9ccee7e7"} Jul 01 22:38:12.438604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.438297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"d8a29546a8695f85a036720c6557affb2256df0e8ef9a60d4aa1a2b3c90d1f49"} Jul 01 22:38:12.438604 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.438321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"29ee3090-32c7-40fe-b458-c77533bf8e34","Type":"ContainerStarted","Data":"314afbc8720107bfad314341549406517db93e26713af312a7c7560f01165638"} Jul 01 22:38:12.466727 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:12.466662 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.446151241 podStartE2EDuration="3.466639102s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.487861ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:38:12.46547977 +0000 UTC m=+107.088853334" watchObservedRunningTime="2026-07-01 22:38:12.466639102 +0000 UTC m=+107.090012655" Jul 01 22:38:15.112973 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:15.112924 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:38:17.305491 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:38:17.305456 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t4t8t" Jul 01 22:39:10.112968 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:10.112926 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:39:10.128205 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:10.128181 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:39:10.692227 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:10.692200 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:39:26.537706 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.537617 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-89g8x"] Jul 01 22:39:26.540054 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.540020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.542616 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.542597 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 22:39:26.542711 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.542647 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 22:39:26.542711 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.542660 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ncml2\"" Jul 01 22:39:26.550669 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.550646 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-89g8x"] Jul 01 22:39:26.654820 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.654787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwqrs\" (UniqueName: \"kubernetes.io/projected/747b93e8-91e0-49c4-9d94-d852f2ee355d-kube-api-access-bwqrs\") pod \"cert-manager-cainjector-5d99449ffd-89g8x\" (UID: \"747b93e8-91e0-49c4-9d94-d852f2ee355d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.655004 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.654846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/747b93e8-91e0-49c4-9d94-d852f2ee355d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-89g8x\" (UID: \"747b93e8-91e0-49c4-9d94-d852f2ee355d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.755269 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.755239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/747b93e8-91e0-49c4-9d94-d852f2ee355d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-89g8x\" (UID: \"747b93e8-91e0-49c4-9d94-d852f2ee355d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.755434 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.755300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwqrs\" (UniqueName: \"kubernetes.io/projected/747b93e8-91e0-49c4-9d94-d852f2ee355d-kube-api-access-bwqrs\") pod \"cert-manager-cainjector-5d99449ffd-89g8x\" (UID: \"747b93e8-91e0-49c4-9d94-d852f2ee355d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.763326 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.763294 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/747b93e8-91e0-49c4-9d94-d852f2ee355d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-89g8x\" (UID: \"747b93e8-91e0-49c4-9d94-d852f2ee355d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.763520 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.763498 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwqrs\" (UniqueName: \"kubernetes.io/projected/747b93e8-91e0-49c4-9d94-d852f2ee355d-kube-api-access-bwqrs\") pod \"cert-manager-cainjector-5d99449ffd-89g8x\" (UID: \"747b93e8-91e0-49c4-9d94-d852f2ee355d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.864290 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.864252 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" Jul 01 22:39:26.991107 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:26.991034 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-89g8x"] Jul 01 22:39:26.993368 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:39:26.993339 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod747b93e8_91e0_49c4_9d94_d852f2ee355d.slice/crio-57b20f8e657e55e8cb3dcc48416c74f0a21f98858e4e1d9b474c471dbf6bd7ae WatchSource:0}: Error finding container 57b20f8e657e55e8cb3dcc48416c74f0a21f98858e4e1d9b474c471dbf6bd7ae: Status 404 returned error can't find the container with id 57b20f8e657e55e8cb3dcc48416c74f0a21f98858e4e1d9b474c471dbf6bd7ae Jul 01 22:39:27.748086 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:27.748051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" event={"ID":"747b93e8-91e0-49c4-9d94-d852f2ee355d","Type":"ContainerStarted","Data":"57b20f8e657e55e8cb3dcc48416c74f0a21f98858e4e1d9b474c471dbf6bd7ae"} Jul 01 22:39:30.763111 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:30.763075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" event={"ID":"747b93e8-91e0-49c4-9d94-d852f2ee355d","Type":"ContainerStarted","Data":"a91ac0e33cc71075c56863850ed56b91c7f1e6d28d5e9774420ec977301aae78"} Jul 01 22:39:30.780837 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:30.780790 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-89g8x" podStartSLOduration=1.741057426 podStartE2EDuration="4.78077572s" totalImagesPullingTime="3.039718294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:39:30.779901544 +0000 UTC m=+185.403275123" watchObservedRunningTime="2026-07-01 22:39:30.78077572 +0000 UTC m=+185.404149273" Jul 01 22:39:35.239787 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.239754 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92"] Jul 01 22:39:35.241945 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.241920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.245128 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.245105 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 22:39:35.246031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.246013 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:39:35.246130 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.246027 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f5x6z\"" Jul 01 22:39:35.262091 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.262064 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92"] Jul 01 22:39:35.331165 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.331116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06eadab1-9d25-4ac9-8f45-38387ed12f72-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qmn92\" (UID: \"06eadab1-9d25-4ac9-8f45-38387ed12f72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.331337 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.331196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lklz7\" (UniqueName: \"kubernetes.io/projected/06eadab1-9d25-4ac9-8f45-38387ed12f72-kube-api-access-lklz7\") pod \"openshift-lws-operator-fd8ccff4c-qmn92\" (UID: \"06eadab1-9d25-4ac9-8f45-38387ed12f72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.431924 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.431892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06eadab1-9d25-4ac9-8f45-38387ed12f72-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qmn92\" (UID: \"06eadab1-9d25-4ac9-8f45-38387ed12f72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.432136 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.431959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lklz7\" (UniqueName: \"kubernetes.io/projected/06eadab1-9d25-4ac9-8f45-38387ed12f72-kube-api-access-lklz7\") pod \"openshift-lws-operator-fd8ccff4c-qmn92\" (UID: \"06eadab1-9d25-4ac9-8f45-38387ed12f72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.432303 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.432281 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06eadab1-9d25-4ac9-8f45-38387ed12f72-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qmn92\" (UID: \"06eadab1-9d25-4ac9-8f45-38387ed12f72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.440444 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.440415 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lklz7\" (UniqueName: \"kubernetes.io/projected/06eadab1-9d25-4ac9-8f45-38387ed12f72-kube-api-access-lklz7\") pod \"openshift-lws-operator-fd8ccff4c-qmn92\" (UID: \"06eadab1-9d25-4ac9-8f45-38387ed12f72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.550665 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.550573 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" Jul 01 22:39:35.681264 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.681242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92"] Jul 01 22:39:35.683895 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:39:35.683864 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06eadab1_9d25_4ac9_8f45_38387ed12f72.slice/crio-e1460a5768df87858a58d6244b80c3c015c092ba54249d3ac5ae35008c6eb136 WatchSource:0}: Error finding container e1460a5768df87858a58d6244b80c3c015c092ba54249d3ac5ae35008c6eb136: Status 404 returned error can't find the container with id e1460a5768df87858a58d6244b80c3c015c092ba54249d3ac5ae35008c6eb136 Jul 01 22:39:35.785068 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:35.785041 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" event={"ID":"06eadab1-9d25-4ac9-8f45-38387ed12f72","Type":"ContainerStarted","Data":"e1460a5768df87858a58d6244b80c3c015c092ba54249d3ac5ae35008c6eb136"} Jul 01 22:39:38.801923 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:38.801846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" event={"ID":"06eadab1-9d25-4ac9-8f45-38387ed12f72","Type":"ContainerStarted","Data":"ccefc3499e11d633b7d8e8674d58bb3b233cb055dd18492b5327cb9721355400"} Jul 01 22:39:38.818829 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:38.818779 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qmn92" podStartSLOduration=1.123482304 podStartE2EDuration="3.818763081s" totalImagesPullingTime="2.695280777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:39:38.817917901 +0000 UTC m=+193.441291454" watchObservedRunningTime="2026-07-01 22:39:38.818763081 +0000 UTC m=+193.442136633" Jul 01 22:39:54.660788 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.660752 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv"] Jul 01 22:39:54.663048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.663033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.679272 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.679252 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 22:39:54.679404 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.679274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 22:39:54.679404 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.679274 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 22:39:54.679404 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.679274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wft2\"" Jul 01 22:39:54.679404 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.679252 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 22:39:54.712636 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.712611 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv"] Jul 01 22:39:54.807883 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.807836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-manifests\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.808087 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.807896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs6ct\" (UniqueName: \"kubernetes.io/projected/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-kube-api-access-fs6ct\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.808087 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.808009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-webhook-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.808087 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.808062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-tmp\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.808087 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.808079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.908833 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.908798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-manifests\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.909055 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.908845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs6ct\" (UniqueName: \"kubernetes.io/projected/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-kube-api-access-fs6ct\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.909055 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.908888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-webhook-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.909055 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.908955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-tmp\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.909055 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.908983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.909289 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.909259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-manifests\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.911270 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.911200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-tmp\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.911400 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.911383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-webhook-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.911458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.911390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.920167 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.920147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs6ct\" (UniqueName: \"kubernetes.io/projected/c1d24cf2-6fd8-47c9-be7d-07fad00edaca-kube-api-access-fs6ct\") pod \"opendatahub-operator-controller-manager-d96464f6-7mljv\" (UID: \"c1d24cf2-6fd8-47c9-be7d-07fad00edaca\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:54.973142 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:54.973111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:39:55.108426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:55.108402 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv"] Jul 01 22:39:55.110271 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:39:55.110247 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d24cf2_6fd8_47c9_be7d_07fad00edaca.slice/crio-c4668638e27e16664964e72177af01bc8e4cd633d5b991e5568f3ea3299ceca5 WatchSource:0}: Error finding container c4668638e27e16664964e72177af01bc8e4cd633d5b991e5568f3ea3299ceca5: Status 404 returned error can't find the container with id c4668638e27e16664964e72177af01bc8e4cd633d5b991e5568f3ea3299ceca5 Jul 01 22:39:55.872715 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:55.872681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" event={"ID":"c1d24cf2-6fd8-47c9-be7d-07fad00edaca","Type":"ContainerStarted","Data":"c4668638e27e16664964e72177af01bc8e4cd633d5b991e5568f3ea3299ceca5"} Jul 01 22:39:58.888751 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:58.888711 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" event={"ID":"c1d24cf2-6fd8-47c9-be7d-07fad00edaca","Type":"ContainerStarted","Data":"ec184693106526291bc8534ed6ada0ec81c127573e2ecaa76e3ac8d8605c6135"} Jul 01 22:39:59.894888 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:59.894817 2579 generic.go:356] "Generic (PLEG): container finished" podID="c1d24cf2-6fd8-47c9-be7d-07fad00edaca" containerID="ec184693106526291bc8534ed6ada0ec81c127573e2ecaa76e3ac8d8605c6135" exitCode=0 Jul 01 22:39:59.895454 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:39:59.894906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" event={"ID":"c1d24cf2-6fd8-47c9-be7d-07fad00edaca","Type":"ContainerDied","Data":"ec184693106526291bc8534ed6ada0ec81c127573e2ecaa76e3ac8d8605c6135"} Jul 01 22:40:00.901497 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:00.901465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" event={"ID":"c1d24cf2-6fd8-47c9-be7d-07fad00edaca","Type":"ContainerStarted","Data":"25eab1bc93cf0b8aa5d9776cbc74f9710431804bb3f990e67063b6fcaa58be70"} Jul 01 22:40:00.901885 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:00.901602 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:40:00.925469 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:00.925423 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" podStartSLOduration=2.761279042 podStartE2EDuration="6.925406982s" totalImagesPullingTime="3.156312352s" totalInitContainerRuntime="1.007815588s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:00.923705147 +0000 UTC m=+215.547078715" watchObservedRunningTime="2026-07-01 22:40:00.925406982 +0000 UTC m=+215.548780534" Jul 01 22:40:11.908046 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:11.908014 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-7mljv" Jul 01 22:40:14.403062 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.403028 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j"] Jul 01 22:40:14.418673 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.418644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.422369 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.422345 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 22:40:14.422616 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.422345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 22:40:14.422777 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.422393 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 22:40:14.422890 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.422508 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rrl59\"" Jul 01 22:40:14.425038 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.425016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j"] Jul 01 22:40:14.592601 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.592573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70d95fac-6321-48f1-a4a2-7a6300b781e1-metrics-cert\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.592601 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.592609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70d95fac-6321-48f1-a4a2-7a6300b781e1-cert\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.592821 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.592701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5vk\" (UniqueName: \"kubernetes.io/projected/70d95fac-6321-48f1-a4a2-7a6300b781e1-kube-api-access-gs5vk\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.592821 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.592793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70d95fac-6321-48f1-a4a2-7a6300b781e1-manager-config\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.693879 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.693801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70d95fac-6321-48f1-a4a2-7a6300b781e1-manager-config\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.693879 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.693847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70d95fac-6321-48f1-a4a2-7a6300b781e1-metrics-cert\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.693879 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.693863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70d95fac-6321-48f1-a4a2-7a6300b781e1-cert\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.694178 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.693911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5vk\" (UniqueName: \"kubernetes.io/projected/70d95fac-6321-48f1-a4a2-7a6300b781e1-kube-api-access-gs5vk\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.694576 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.694551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70d95fac-6321-48f1-a4a2-7a6300b781e1-manager-config\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.696318 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.696291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70d95fac-6321-48f1-a4a2-7a6300b781e1-cert\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.696411 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.696325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70d95fac-6321-48f1-a4a2-7a6300b781e1-metrics-cert\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.724125 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.724097 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5vk\" (UniqueName: \"kubernetes.io/projected/70d95fac-6321-48f1-a4a2-7a6300b781e1-kube-api-access-gs5vk\") pod \"lws-controller-manager-bb7dc95cc-mwf9j\" (UID: \"70d95fac-6321-48f1-a4a2-7a6300b781e1\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.731875 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.731849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:14.875270 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.875248 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j"] Jul 01 22:40:14.877819 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:40:14.877785 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d95fac_6321_48f1_a4a2_7a6300b781e1.slice/crio-5001eeb28efbc123400c8547fe0127e7305e83af12ac71740d337c19111bac82 WatchSource:0}: Error finding container 5001eeb28efbc123400c8547fe0127e7305e83af12ac71740d337c19111bac82: Status 404 returned error can't find the container with id 5001eeb28efbc123400c8547fe0127e7305e83af12ac71740d337c19111bac82 Jul 01 22:40:14.965601 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:14.965523 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" event={"ID":"70d95fac-6321-48f1-a4a2-7a6300b781e1","Type":"ContainerStarted","Data":"5001eeb28efbc123400c8547fe0127e7305e83af12ac71740d337c19111bac82"} Jul 01 22:40:16.975181 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:16.975148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" event={"ID":"70d95fac-6321-48f1-a4a2-7a6300b781e1","Type":"ContainerStarted","Data":"0f6b0a1c320de38747be85e670ebedfac5fa41c5d8e9c434edc8aba8cb15adf0"} Jul 01 22:40:16.975567 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:16.975245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:16.993787 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:16.993746 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" podStartSLOduration=1.03829597 podStartE2EDuration="2.993730873s" totalImagesPullingTime="1.955434903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:16.991534904 +0000 UTC m=+231.614908455" watchObservedRunningTime="2026-07-01 22:40:16.993730873 +0000 UTC m=+231.617104425" Jul 01 22:40:24.743629 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.743593 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw"] Jul 01 22:40:24.747100 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.747084 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.749558 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.749533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 22:40:24.749891 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.749874 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dg4z6\"" Jul 01 22:40:24.750340 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.750325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 22:40:24.763659 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.763639 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 22:40:24.763771 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.763639 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 22:40:24.781179 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.781145 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw"] Jul 01 22:40:24.783676 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.783653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tmp\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.783819 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.783719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tls-certs\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.783819 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.783760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldh84\" (UniqueName: \"kubernetes.io/projected/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-kube-api-access-ldh84\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.884671 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.884640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tmp\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.884877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.884700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tls-certs\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.884877 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.884731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldh84\" (UniqueName: \"kubernetes.io/projected/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-kube-api-access-ldh84\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.884877 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:40:24.884799 2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 01 22:40:24.885144 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:40:24.884885 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tls-certs podName:ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af nodeName:}" failed. No retries permitted until 2026-07-01 22:40:25.384862226 +0000 UTC m=+240.008235757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tls-certs") pod "kube-auth-proxy-69f8c56ffb-59dpw" (UID: "ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af") : secret "kube-auth-proxy-tls" not found Jul 01 22:40:24.886908 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.886879 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tmp\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:24.901312 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:24.901282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldh84\" (UniqueName: \"kubernetes.io/projected/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-kube-api-access-ldh84\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:25.388650 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:25.388616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tls-certs\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:25.390949 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:25.390919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af-tls-certs\") pod \"kube-auth-proxy-69f8c56ffb-59dpw\" (UID: \"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af\") " pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:25.656870 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:25.656792 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" Jul 01 22:40:25.820816 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:25.820794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw"] Jul 01 22:40:25.822540 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:40:25.822518 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3adb2a_d3dd_46db_8ddd_b514a4e7f0af.slice/crio-cdfff55faa2aca91511d90dfd9b902d8ec6c4bd518f82b208f50d5196701304f WatchSource:0}: Error finding container cdfff55faa2aca91511d90dfd9b902d8ec6c4bd518f82b208f50d5196701304f: Status 404 returned error can't find the container with id cdfff55faa2aca91511d90dfd9b902d8ec6c4bd518f82b208f50d5196701304f Jul 01 22:40:26.020771 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:26.020690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" event={"ID":"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af","Type":"ContainerStarted","Data":"cdfff55faa2aca91511d90dfd9b902d8ec6c4bd518f82b208f50d5196701304f"} Jul 01 22:40:27.982335 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:27.982309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mwf9j" Jul 01 22:40:28.608655 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:28.608634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 22:40:29.039136 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:29.039044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" event={"ID":"ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af","Type":"ContainerStarted","Data":"bd0617f50405dc972eda1ed7e042ebb97b5c65351f63790f8cc32ef21b05df79"} Jul 01 22:40:29.071564 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:40:29.071514 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69f8c56ffb-59dpw" podStartSLOduration=2.289718432 podStartE2EDuration="5.071499468s" totalImagesPullingTime="2.781781036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:29.069357536 +0000 UTC m=+243.692731090" watchObservedRunningTime="2026-07-01 22:40:29.071499468 +0000 UTC m=+243.694873049" Jul 01 22:41:25.730255 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:25.730227 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:41:25.734588 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:25.734564 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 22:41:25.738417 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:25.738399 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:41:58.445031 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.444998 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp"] Jul 01 22:41:58.448468 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.448452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:41:58.451056 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.451038 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f77qf\"" Jul 01 22:41:58.451303 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.451288 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 22:41:58.451737 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.451722 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 22:41:58.459235 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.459215 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp"] Jul 01 22:41:58.524555 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.524518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br7cv\" (UniqueName: \"kubernetes.io/projected/46a68aaa-f43a-4c15-9ec7-4750be1850fe-kube-api-access-br7cv\") pod \"authorino-operator-75cc8d5cb7-7fvsp\" (UID: \"46a68aaa-f43a-4c15-9ec7-4750be1850fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:41:58.625470 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.625435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br7cv\" (UniqueName: \"kubernetes.io/projected/46a68aaa-f43a-4c15-9ec7-4750be1850fe-kube-api-access-br7cv\") pod \"authorino-operator-75cc8d5cb7-7fvsp\" (UID: \"46a68aaa-f43a-4c15-9ec7-4750be1850fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:41:58.643575 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.643543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br7cv\" (UniqueName: \"kubernetes.io/projected/46a68aaa-f43a-4c15-9ec7-4750be1850fe-kube-api-access-br7cv\") pod \"authorino-operator-75cc8d5cb7-7fvsp\" (UID: \"46a68aaa-f43a-4c15-9ec7-4750be1850fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:41:58.759092 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.759017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:41:58.900245 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.900212 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp"] Jul 01 22:41:58.901431 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:41:58.901403 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a68aaa_f43a_4c15_9ec7_4750be1850fe.slice/crio-90b6493ab14f88a6c9e3074fe4bfc16250e62422ea65258ef596ce30f914b0f5 WatchSource:0}: Error finding container 90b6493ab14f88a6c9e3074fe4bfc16250e62422ea65258ef596ce30f914b0f5: Status 404 returned error can't find the container with id 90b6493ab14f88a6c9e3074fe4bfc16250e62422ea65258ef596ce30f914b0f5 Jul 01 22:41:58.903606 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:58.903589 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:41:59.439785 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:41:59.439753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" event={"ID":"46a68aaa-f43a-4c15-9ec7-4750be1850fe","Type":"ContainerStarted","Data":"90b6493ab14f88a6c9e3074fe4bfc16250e62422ea65258ef596ce30f914b0f5"} Jul 01 22:42:01.450745 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:01.450712 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" event={"ID":"46a68aaa-f43a-4c15-9ec7-4750be1850fe","Type":"ContainerStarted","Data":"2535df893db4d480d69a6799b54a48c457ba551f9aed3e8569254cad9788c481"} Jul 01 22:42:01.451120 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:01.450774 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:42:01.470001 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:01.469916 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" podStartSLOduration=1.132984521 podStartE2EDuration="3.469901932s" totalImagesPullingTime="2.336917411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:01.468159137 +0000 UTC m=+336.091532689" watchObservedRunningTime="2026-07-01 22:42:01.469901932 +0000 UTC m=+336.093275483" Jul 01 22:42:12.457663 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:12.457632 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7fvsp" Jul 01 22:42:45.927245 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:45.927209 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-m6gwl"] Jul 01 22:42:45.934109 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:45.934082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:45.938239 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:45.938218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9j7x9\"" Jul 01 22:42:45.942613 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:45.942590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-m6gwl"] Jul 01 22:42:46.061553 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.061516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmg2f\" (UniqueName: \"kubernetes.io/projected/c8a129ee-67f5-4179-934c-c03325b2d65e-kube-api-access-dmg2f\") pod \"authorino-58cd955675-m6gwl\" (UID: \"c8a129ee-67f5-4179-934c-c03325b2d65e\") " pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:46.128366 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.128331 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n6f8d"] Jul 01 22:42:46.131810 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.131788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:42:46.137821 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.137794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n6f8d"] Jul 01 22:42:46.162497 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.162472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmg2f\" (UniqueName: \"kubernetes.io/projected/c8a129ee-67f5-4179-934c-c03325b2d65e-kube-api-access-dmg2f\") pod \"authorino-58cd955675-m6gwl\" (UID: \"c8a129ee-67f5-4179-934c-c03325b2d65e\") " pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:46.172298 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.172271 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmg2f\" (UniqueName: \"kubernetes.io/projected/c8a129ee-67f5-4179-934c-c03325b2d65e-kube-api-access-dmg2f\") pod \"authorino-58cd955675-m6gwl\" (UID: \"c8a129ee-67f5-4179-934c-c03325b2d65e\") " pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:46.243324 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.243250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:46.263341 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.263303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6pl\" (UniqueName: \"kubernetes.io/projected/9150069d-05dd-4deb-8a62-e34c645722ec-kube-api-access-8x6pl\") pod \"authorino-75d556bd77-n6f8d\" (UID: \"9150069d-05dd-4deb-8a62-e34c645722ec\") " pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:42:46.364540 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.364506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6pl\" (UniqueName: \"kubernetes.io/projected/9150069d-05dd-4deb-8a62-e34c645722ec-kube-api-access-8x6pl\") pod \"authorino-75d556bd77-n6f8d\" (UID: \"9150069d-05dd-4deb-8a62-e34c645722ec\") " pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:42:46.372583 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.372557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-m6gwl"] Jul 01 22:42:46.375351 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:42:46.375315 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8a129ee_67f5_4179_934c_c03325b2d65e.slice/crio-b5e4ef23587479a927d145775cd0234d61f3b17118cf5d8a78a4bfc96192b59e WatchSource:0}: Error finding container b5e4ef23587479a927d145775cd0234d61f3b17118cf5d8a78a4bfc96192b59e: Status 404 returned error can't find the container with id b5e4ef23587479a927d145775cd0234d61f3b17118cf5d8a78a4bfc96192b59e Jul 01 22:42:46.375351 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.375342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6pl\" (UniqueName: \"kubernetes.io/projected/9150069d-05dd-4deb-8a62-e34c645722ec-kube-api-access-8x6pl\") pod \"authorino-75d556bd77-n6f8d\" (UID: \"9150069d-05dd-4deb-8a62-e34c645722ec\") " pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:42:46.441003 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.440966 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:42:46.565423 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.565356 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n6f8d"] Jul 01 22:42:46.567918 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:42:46.567891 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9150069d_05dd_4deb_8a62_e34c645722ec.slice/crio-92d30170932ab7cc3c4e2c0b730578d5c25634d9d484b48c7bdf1e79e604d2c3 WatchSource:0}: Error finding container 92d30170932ab7cc3c4e2c0b730578d5c25634d9d484b48c7bdf1e79e604d2c3: Status 404 returned error can't find the container with id 92d30170932ab7cc3c4e2c0b730578d5c25634d9d484b48c7bdf1e79e604d2c3 Jul 01 22:42:46.663365 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.663332 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n6f8d" event={"ID":"9150069d-05dd-4deb-8a62-e34c645722ec","Type":"ContainerStarted","Data":"92d30170932ab7cc3c4e2c0b730578d5c25634d9d484b48c7bdf1e79e604d2c3"} Jul 01 22:42:46.664382 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:46.664364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m6gwl" event={"ID":"c8a129ee-67f5-4179-934c-c03325b2d65e","Type":"ContainerStarted","Data":"b5e4ef23587479a927d145775cd0234d61f3b17118cf5d8a78a4bfc96192b59e"} Jul 01 22:42:50.688279 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:50.688245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n6f8d" event={"ID":"9150069d-05dd-4deb-8a62-e34c645722ec","Type":"ContainerStarted","Data":"8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4"} Jul 01 22:42:50.689739 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:50.689717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m6gwl" event={"ID":"c8a129ee-67f5-4179-934c-c03325b2d65e","Type":"ContainerStarted","Data":"41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313"} Jul 01 22:42:50.709295 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:50.709249 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n6f8d" podStartSLOduration=1.4719703800000001 podStartE2EDuration="4.709234996s" totalImagesPullingTime="3.237264616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:50.707559052 +0000 UTC m=+385.330932603" watchObservedRunningTime="2026-07-01 22:42:50.709234996 +0000 UTC m=+385.332608526" Jul 01 22:42:50.723336 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:50.723285 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-m6gwl" podStartSLOduration=2.307821828 podStartE2EDuration="5.723265558s" totalImagesPullingTime="3.41544373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:50.722348806 +0000 UTC m=+385.345722359" watchObservedRunningTime="2026-07-01 22:42:50.723265558 +0000 UTC m=+385.346639111" Jul 01 22:42:50.764120 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:50.764087 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-m6gwl"] Jul 01 22:42:52.698870 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:52.698828 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-m6gwl" podUID="c8a129ee-67f5-4179-934c-c03325b2d65e" containerName="authorino" containerID="cri-o://41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313" gracePeriod=30 Jul 01 22:42:52.948179 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:52.948152 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:53.135538 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.135503 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmg2f\" (UniqueName: \"kubernetes.io/projected/c8a129ee-67f5-4179-934c-c03325b2d65e-kube-api-access-dmg2f\") pod \"c8a129ee-67f5-4179-934c-c03325b2d65e\" (UID: \"c8a129ee-67f5-4179-934c-c03325b2d65e\") " Jul 01 22:42:53.137606 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.137577 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a129ee-67f5-4179-934c-c03325b2d65e-kube-api-access-dmg2f" (OuterVolumeSpecName: "kube-api-access-dmg2f") pod "c8a129ee-67f5-4179-934c-c03325b2d65e" (UID: "c8a129ee-67f5-4179-934c-c03325b2d65e"). InnerVolumeSpecName "kube-api-access-dmg2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:42:53.236613 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.236578 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmg2f\" (UniqueName: \"kubernetes.io/projected/c8a129ee-67f5-4179-934c-c03325b2d65e-kube-api-access-dmg2f\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:42:53.704585 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.704552 2579 generic.go:356] "Generic (PLEG): container finished" podID="c8a129ee-67f5-4179-934c-c03325b2d65e" containerID="41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313" exitCode=0 Jul 01 22:42:53.705048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.704591 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m6gwl" Jul 01 22:42:53.705048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.704605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m6gwl" event={"ID":"c8a129ee-67f5-4179-934c-c03325b2d65e","Type":"ContainerDied","Data":"41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313"} Jul 01 22:42:53.705048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.704642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m6gwl" event={"ID":"c8a129ee-67f5-4179-934c-c03325b2d65e","Type":"ContainerDied","Data":"b5e4ef23587479a927d145775cd0234d61f3b17118cf5d8a78a4bfc96192b59e"} Jul 01 22:42:53.705048 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.704666 2579 scope.go:117] "RemoveContainer" containerID="41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313" Jul 01 22:42:53.713332 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.713313 2579 scope.go:117] "RemoveContainer" containerID="41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313" Jul 01 22:42:53.713616 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:42:53.713598 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313\": container with ID starting with 41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313 not found: ID does not exist" containerID="41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313" Jul 01 22:42:53.713673 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.713628 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313"} err="failed to get container status \"41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313\": rpc error: code = NotFound desc = could not find container \"41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313\": container with ID starting with 41924d2b4bb87d19488a1769e1b11f573e0f3018cff75404fcda004211ca0313 not found: ID does not exist" Jul 01 22:42:53.725425 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.725399 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-m6gwl"] Jul 01 22:42:53.730447 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.730427 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-m6gwl"] Jul 01 22:42:53.785538 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:42:53.785509 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a129ee-67f5-4179-934c-c03325b2d65e" path="/var/lib/kubelet/pods/c8a129ee-67f5-4179-934c-c03325b2d65e/volumes" Jul 01 22:43:50.790963 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.790859 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:43:50.791490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.791415 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a129ee-67f5-4179-934c-c03325b2d65e" containerName="authorino" Jul 01 22:43:50.791490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.791434 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a129ee-67f5-4179-934c-c03325b2d65e" containerName="authorino" Jul 01 22:43:50.791615 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.791518 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a129ee-67f5-4179-934c-c03325b2d65e" containerName="authorino" Jul 01 22:43:50.794554 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.794537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 22:43:50.797089 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.797068 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 22:43:50.797815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.797798 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rz4ff\"" Jul 01 22:43:50.797815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.797804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 22:43:50.797966 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.797817 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 22:43:50.809061 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.809042 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:43:50.853129 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.853104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gn6c\" (UniqueName: \"kubernetes.io/projected/9a241051-0b74-470e-814b-d3b8ee82ad3e-kube-api-access-2gn6c\") pod \"maas-keycloak-0\" (UID: \"9a241051-0b74-470e-814b-d3b8ee82ad3e\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:43:50.953862 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.953825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gn6c\" (UniqueName: \"kubernetes.io/projected/9a241051-0b74-470e-814b-d3b8ee82ad3e-kube-api-access-2gn6c\") pod \"maas-keycloak-0\" (UID: \"9a241051-0b74-470e-814b-d3b8ee82ad3e\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:43:50.962277 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:50.962254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gn6c\" (UniqueName: \"kubernetes.io/projected/9a241051-0b74-470e-814b-d3b8ee82ad3e-kube-api-access-2gn6c\") pod \"maas-keycloak-0\" (UID: \"9a241051-0b74-470e-814b-d3b8ee82ad3e\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:43:51.103904 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:51.103872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 22:43:51.236387 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:51.236361 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:43:51.238486 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:43:51.238448 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a241051_0b74_470e_814b_d3b8ee82ad3e.slice/crio-c81718a37b34f0da1cb5c44975e33fdb52cb4d0daa8592723c475405006a835a WatchSource:0}: Error finding container c81718a37b34f0da1cb5c44975e33fdb52cb4d0daa8592723c475405006a835a: Status 404 returned error can't find the container with id c81718a37b34f0da1cb5c44975e33fdb52cb4d0daa8592723c475405006a835a Jul 01 22:43:51.970432 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:51.970349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9a241051-0b74-470e-814b-d3b8ee82ad3e","Type":"ContainerStarted","Data":"c81718a37b34f0da1cb5c44975e33fdb52cb4d0daa8592723c475405006a835a"} Jul 01 22:43:55.993869 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:55.993784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9a241051-0b74-470e-814b-d3b8ee82ad3e","Type":"ContainerStarted","Data":"4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d"} Jul 01 22:43:56.011407 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:56.011335 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.582330442 podStartE2EDuration="6.011315716s" totalImagesPullingTime="4.428985274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:43:56.010530902 +0000 UTC m=+450.633904445" watchObservedRunningTime="2026-07-01 22:43:56.011315716 +0000 UTC m=+450.634689269" Jul 01 22:43:56.104489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:56.104451 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 22:43:56.106081 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:56.106036 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:43:57.105305 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:57.105255 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:43:58.105314 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:58.105262 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:43:59.104774 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:43:59.104712 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:00.105081 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:00.105034 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:01.105265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:01.104529 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 22:44:01.105265 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:01.104854 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:02.105080 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:02.105032 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:03.104622 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:03.104585 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:04.105230 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:04.105191 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:05.104779 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:05.104730 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:06.104807 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:06.104754 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:07.104838 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:07.104788 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:08.104923 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:08.104881 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jul 01 22:44:09.208724 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:09.208360 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 22:44:09.226652 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:09.226590 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 22:44:19.215454 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:19.215421 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 22:44:20.084884 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.084851 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kmb8z"] Jul 01 22:44:20.087431 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.087411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:20.092978 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.092953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kmb8z"] Jul 01 22:44:20.145823 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.145796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntwbv\" (UniqueName: \"kubernetes.io/projected/f85f7f1d-ca81-46a4-9a32-c763832f902d-kube-api-access-ntwbv\") pod \"authorino-5d4b67c446-kmb8z\" (UID: \"f85f7f1d-ca81-46a4-9a32-c763832f902d\") " pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:20.246446 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.246414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntwbv\" (UniqueName: \"kubernetes.io/projected/f85f7f1d-ca81-46a4-9a32-c763832f902d-kube-api-access-ntwbv\") pod \"authorino-5d4b67c446-kmb8z\" (UID: \"f85f7f1d-ca81-46a4-9a32-c763832f902d\") " pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:20.255181 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.255153 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntwbv\" (UniqueName: \"kubernetes.io/projected/f85f7f1d-ca81-46a4-9a32-c763832f902d-kube-api-access-ntwbv\") pod \"authorino-5d4b67c446-kmb8z\" (UID: \"f85f7f1d-ca81-46a4-9a32-c763832f902d\") " pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:20.333204 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.333171 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kmb8z"] Jul 01 22:44:20.333463 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.333450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:20.370593 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.370558 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66d475f7f-j89qp"] Jul 01 22:44:20.373124 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.373104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:20.387490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.387452 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66d475f7f-j89qp"] Jul 01 22:44:20.448649 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.448604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9nzc\" (UniqueName: \"kubernetes.io/projected/ce090c76-426f-435d-b4e4-c367e77554e4-kube-api-access-x9nzc\") pod \"authorino-66d475f7f-j89qp\" (UID: \"ce090c76-426f-435d-b4e4-c367e77554e4\") " pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:20.464825 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.464799 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kmb8z"] Jul 01 22:44:20.467394 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:44:20.467368 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf85f7f1d_ca81_46a4_9a32_c763832f902d.slice/crio-370b76f8a5ca5fee215229b29765e206b0391233c916f171ffffacf0c8aa5020 WatchSource:0}: Error finding container 370b76f8a5ca5fee215229b29765e206b0391233c916f171ffffacf0c8aa5020: Status 404 returned error can't find the container with id 370b76f8a5ca5fee215229b29765e206b0391233c916f171ffffacf0c8aa5020 Jul 01 22:44:20.549627 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.549584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9nzc\" (UniqueName: \"kubernetes.io/projected/ce090c76-426f-435d-b4e4-c367e77554e4-kube-api-access-x9nzc\") pod \"authorino-66d475f7f-j89qp\" (UID: \"ce090c76-426f-435d-b4e4-c367e77554e4\") " pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:20.558186 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.558157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9nzc\" (UniqueName: \"kubernetes.io/projected/ce090c76-426f-435d-b4e4-c367e77554e4-kube-api-access-x9nzc\") pod \"authorino-66d475f7f-j89qp\" (UID: \"ce090c76-426f-435d-b4e4-c367e77554e4\") " pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:20.645028 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.644954 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66d475f7f-j89qp"] Jul 01 22:44:20.645228 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.645217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:20.672169 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.672141 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b5578bfdc-w849c"] Jul 01 22:44:20.675135 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.675113 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.677581 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.677554 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 22:44:20.684238 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.684213 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b5578bfdc-w849c"] Jul 01 22:44:20.752012 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.751985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d0e581f-e7f8-41a5-98f1-4e5025099275-tls-cert\") pod \"authorino-b5578bfdc-w849c\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.752012 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.752021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsz5t\" (UniqueName: \"kubernetes.io/projected/2d0e581f-e7f8-41a5-98f1-4e5025099275-kube-api-access-lsz5t\") pod \"authorino-b5578bfdc-w849c\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.780448 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.780420 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66d475f7f-j89qp"] Jul 01 22:44:20.782482 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:44:20.782461 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce090c76_426f_435d_b4e4_c367e77554e4.slice/crio-55f39ffe405994c07fe261d7310ed6dab53b614ba44d0038bb983126307c2c3f WatchSource:0}: Error finding container 55f39ffe405994c07fe261d7310ed6dab53b614ba44d0038bb983126307c2c3f: Status 404 returned error can't find the container with id 55f39ffe405994c07fe261d7310ed6dab53b614ba44d0038bb983126307c2c3f Jul 01 22:44:20.853358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.853329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d0e581f-e7f8-41a5-98f1-4e5025099275-tls-cert\") pod \"authorino-b5578bfdc-w849c\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.853358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.853362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsz5t\" (UniqueName: \"kubernetes.io/projected/2d0e581f-e7f8-41a5-98f1-4e5025099275-kube-api-access-lsz5t\") pod \"authorino-b5578bfdc-w849c\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.855728 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.855699 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d0e581f-e7f8-41a5-98f1-4e5025099275-tls-cert\") pod \"authorino-b5578bfdc-w849c\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.861613 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.861591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsz5t\" (UniqueName: \"kubernetes.io/projected/2d0e581f-e7f8-41a5-98f1-4e5025099275-kube-api-access-lsz5t\") pod \"authorino-b5578bfdc-w849c\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:20.986836 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:20.986760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:44:21.116709 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.116685 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b5578bfdc-w849c"] Jul 01 22:44:21.118456 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:44:21.118422 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d0e581f_e7f8_41a5_98f1_4e5025099275.slice/crio-511296e2911cdbecbe81a95a0794521c005f229bcb7b8b54b1d7ecb9f6fbd0e5 WatchSource:0}: Error finding container 511296e2911cdbecbe81a95a0794521c005f229bcb7b8b54b1d7ecb9f6fbd0e5: Status 404 returned error can't find the container with id 511296e2911cdbecbe81a95a0794521c005f229bcb7b8b54b1d7ecb9f6fbd0e5 Jul 01 22:44:21.149627 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.149604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b5578bfdc-w849c" event={"ID":"2d0e581f-e7f8-41a5-98f1-4e5025099275","Type":"ContainerStarted","Data":"511296e2911cdbecbe81a95a0794521c005f229bcb7b8b54b1d7ecb9f6fbd0e5"} Jul 01 22:44:21.150757 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.150731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d475f7f-j89qp" event={"ID":"ce090c76-426f-435d-b4e4-c367e77554e4","Type":"ContainerStarted","Data":"55f39ffe405994c07fe261d7310ed6dab53b614ba44d0038bb983126307c2c3f"} Jul 01 22:44:21.152224 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.152202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" event={"ID":"f85f7f1d-ca81-46a4-9a32-c763832f902d","Type":"ContainerStarted","Data":"429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69"} Jul 01 22:44:21.152319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.152234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" event={"ID":"f85f7f1d-ca81-46a4-9a32-c763832f902d","Type":"ContainerStarted","Data":"370b76f8a5ca5fee215229b29765e206b0391233c916f171ffffacf0c8aa5020"} Jul 01 22:44:21.152319 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.152234 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" podUID="f85f7f1d-ca81-46a4-9a32-c763832f902d" containerName="authorino" containerID="cri-o://429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69" gracePeriod=30 Jul 01 22:44:21.172298 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.172243 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" podStartSLOduration=0.872525067 podStartE2EDuration="1.172228328s" totalImagesPullingTime="299.703261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:44:21.169982329 +0000 UTC m=+475.793355881" watchObservedRunningTime="2026-07-01 22:44:21.172228328 +0000 UTC m=+475.795601879" Jul 01 22:44:21.410098 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.410074 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:21.459144 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.459112 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntwbv\" (UniqueName: \"kubernetes.io/projected/f85f7f1d-ca81-46a4-9a32-c763832f902d-kube-api-access-ntwbv\") pod \"f85f7f1d-ca81-46a4-9a32-c763832f902d\" (UID: \"f85f7f1d-ca81-46a4-9a32-c763832f902d\") " Jul 01 22:44:21.461198 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.461174 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85f7f1d-ca81-46a4-9a32-c763832f902d-kube-api-access-ntwbv" (OuterVolumeSpecName: "kube-api-access-ntwbv") pod "f85f7f1d-ca81-46a4-9a32-c763832f902d" (UID: "f85f7f1d-ca81-46a4-9a32-c763832f902d"). InnerVolumeSpecName "kube-api-access-ntwbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:44:21.560354 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:21.560325 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntwbv\" (UniqueName: \"kubernetes.io/projected/f85f7f1d-ca81-46a4-9a32-c763832f902d-kube-api-access-ntwbv\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:44:22.158625 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.158588 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b5578bfdc-w849c" event={"ID":"2d0e581f-e7f8-41a5-98f1-4e5025099275","Type":"ContainerStarted","Data":"8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5"} Jul 01 22:44:22.160275 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.160246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d475f7f-j89qp" event={"ID":"ce090c76-426f-435d-b4e4-c367e77554e4","Type":"ContainerStarted","Data":"a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e"} Jul 01 22:44:22.160275 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.160261 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-66d475f7f-j89qp" podUID="ce090c76-426f-435d-b4e4-c367e77554e4" containerName="authorino" containerID="cri-o://a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e" gracePeriod=30 Jul 01 22:44:22.161551 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.161523 2579 generic.go:356] "Generic (PLEG): container finished" podID="f85f7f1d-ca81-46a4-9a32-c763832f902d" containerID="429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69" exitCode=0 Jul 01 22:44:22.161551 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.161548 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" Jul 01 22:44:22.161698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.161607 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" event={"ID":"f85f7f1d-ca81-46a4-9a32-c763832f902d","Type":"ContainerDied","Data":"429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69"} Jul 01 22:44:22.161698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.161649 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kmb8z" event={"ID":"f85f7f1d-ca81-46a4-9a32-c763832f902d","Type":"ContainerDied","Data":"370b76f8a5ca5fee215229b29765e206b0391233c916f171ffffacf0c8aa5020"} Jul 01 22:44:22.161698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.161673 2579 scope.go:117] "RemoveContainer" containerID="429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69" Jul 01 22:44:22.171115 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.171098 2579 scope.go:117] "RemoveContainer" containerID="429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69" Jul 01 22:44:22.171384 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:22.171365 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69\": container with ID starting with 429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69 not found: ID does not exist" containerID="429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69" Jul 01 22:44:22.171440 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.171393 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69"} err="failed to get container status \"429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69\": rpc error: code = NotFound desc = could not find container \"429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69\": container with ID starting with 429048b252f1a789d31c7a27112dc91a0f34dd344bbd0ea1a5052c0b0a2baf69 not found: ID does not exist" Jul 01 22:44:22.176371 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.176331 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b5578bfdc-w849c" podStartSLOduration=1.832141327 podStartE2EDuration="2.176318722s" totalImagesPullingTime="344.177395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:44:22.175507639 +0000 UTC m=+476.798881192" watchObservedRunningTime="2026-07-01 22:44:22.176318722 +0000 UTC m=+476.799692270" Jul 01 22:44:22.195224 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.195191 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kmb8z"] Jul 01 22:44:22.198360 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.198336 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kmb8z"] Jul 01 22:44:22.211263 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.211235 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n6f8d"] Jul 01 22:44:22.211467 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.211443 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n6f8d" podUID="9150069d-05dd-4deb-8a62-e34c645722ec" containerName="authorino" containerID="cri-o://8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4" gracePeriod=30 Jul 01 22:44:22.216955 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.216881 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66d475f7f-j89qp" podStartSLOduration=1.852543192 podStartE2EDuration="2.216865982s" totalImagesPullingTime="364.32279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:44:22.215165608 +0000 UTC m=+476.838539177" watchObservedRunningTime="2026-07-01 22:44:22.216865982 +0000 UTC m=+476.840239532" Jul 01 22:44:22.481728 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.475447 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:22.484315 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.484290 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:44:22.568328 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.568300 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x6pl\" (UniqueName: \"kubernetes.io/projected/9150069d-05dd-4deb-8a62-e34c645722ec-kube-api-access-8x6pl\") pod \"9150069d-05dd-4deb-8a62-e34c645722ec\" (UID: \"9150069d-05dd-4deb-8a62-e34c645722ec\") " Jul 01 22:44:22.568518 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.568344 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9nzc\" (UniqueName: \"kubernetes.io/projected/ce090c76-426f-435d-b4e4-c367e77554e4-kube-api-access-x9nzc\") pod \"ce090c76-426f-435d-b4e4-c367e77554e4\" (UID: \"ce090c76-426f-435d-b4e4-c367e77554e4\") " Jul 01 22:44:22.570433 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.570407 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9150069d-05dd-4deb-8a62-e34c645722ec-kube-api-access-8x6pl" (OuterVolumeSpecName: "kube-api-access-8x6pl") pod "9150069d-05dd-4deb-8a62-e34c645722ec" (UID: "9150069d-05dd-4deb-8a62-e34c645722ec"). InnerVolumeSpecName "kube-api-access-8x6pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:44:22.570541 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.570441 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce090c76-426f-435d-b4e4-c367e77554e4-kube-api-access-x9nzc" (OuterVolumeSpecName: "kube-api-access-x9nzc") pod "ce090c76-426f-435d-b4e4-c367e77554e4" (UID: "ce090c76-426f-435d-b4e4-c367e77554e4"). InnerVolumeSpecName "kube-api-access-x9nzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:44:22.669294 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.669261 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x6pl\" (UniqueName: \"kubernetes.io/projected/9150069d-05dd-4deb-8a62-e34c645722ec-kube-api-access-8x6pl\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:44:22.669294 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:22.669291 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9nzc\" (UniqueName: \"kubernetes.io/projected/ce090c76-426f-435d-b4e4-c367e77554e4-kube-api-access-x9nzc\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:44:23.168267 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.168230 2579 generic.go:356] "Generic (PLEG): container finished" podID="9150069d-05dd-4deb-8a62-e34c645722ec" containerID="8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4" exitCode=0 Jul 01 22:44:23.168458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.168275 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n6f8d" Jul 01 22:44:23.168458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.168319 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n6f8d" event={"ID":"9150069d-05dd-4deb-8a62-e34c645722ec","Type":"ContainerDied","Data":"8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4"} Jul 01 22:44:23.168458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.168365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n6f8d" event={"ID":"9150069d-05dd-4deb-8a62-e34c645722ec","Type":"ContainerDied","Data":"92d30170932ab7cc3c4e2c0b730578d5c25634d9d484b48c7bdf1e79e604d2c3"} Jul 01 22:44:23.168458 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.168387 2579 scope.go:117] "RemoveContainer" containerID="8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4" Jul 01 22:44:23.169594 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.169571 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce090c76-426f-435d-b4e4-c367e77554e4" containerID="a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e" exitCode=0 Jul 01 22:44:23.169720 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.169621 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d475f7f-j89qp" Jul 01 22:44:23.169720 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.169654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d475f7f-j89qp" event={"ID":"ce090c76-426f-435d-b4e4-c367e77554e4","Type":"ContainerDied","Data":"a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e"} Jul 01 22:44:23.169720 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.169697 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d475f7f-j89qp" event={"ID":"ce090c76-426f-435d-b4e4-c367e77554e4","Type":"ContainerDied","Data":"55f39ffe405994c07fe261d7310ed6dab53b614ba44d0038bb983126307c2c3f"} Jul 01 22:44:23.177323 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.177309 2579 scope.go:117] "RemoveContainer" containerID="8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4" Jul 01 22:44:23.177614 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:23.177580 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4\": container with ID starting with 8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4 not found: ID does not exist" containerID="8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4" Jul 01 22:44:23.177678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.177613 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4"} err="failed to get container status \"8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4\": rpc error: code = NotFound desc = could not find container \"8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4\": container with ID starting with 8fd7e908099baee6cb65d80a120b9ee36a49a63a31b66742ab1928db6701bdc4 not found: ID does not exist" Jul 01 22:44:23.177678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.177638 2579 scope.go:117] "RemoveContainer" containerID="a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e" Jul 01 22:44:23.185509 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.185491 2579 scope.go:117] "RemoveContainer" containerID="a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e" Jul 01 22:44:23.185757 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:23.185739 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e\": container with ID starting with a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e not found: ID does not exist" containerID="a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e" Jul 01 22:44:23.185815 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.185768 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e"} err="failed to get container status \"a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e\": rpc error: code = NotFound desc = could not find container \"a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e\": container with ID starting with a891bbcfbd59bc6cb0feb6ab453191e96d5267644e52523ed98ca9aaeaee7a1e not found: ID does not exist" Jul 01 22:44:23.192548 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.192527 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66d475f7f-j89qp"] Jul 01 22:44:23.197024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.197002 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66d475f7f-j89qp"] Jul 01 22:44:23.212302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.212280 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n6f8d"] Jul 01 22:44:23.216445 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.216426 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n6f8d"] Jul 01 22:44:23.786673 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.786643 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9150069d-05dd-4deb-8a62-e34c645722ec" path="/var/lib/kubelet/pods/9150069d-05dd-4deb-8a62-e34c645722ec/volumes" Jul 01 22:44:23.787045 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.786963 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce090c76-426f-435d-b4e4-c367e77554e4" path="/var/lib/kubelet/pods/ce090c76-426f-435d-b4e4-c367e77554e4/volumes" Jul 01 22:44:23.787251 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:23.787238 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f85f7f1d-ca81-46a4-9a32-c763832f902d" path="/var/lib/kubelet/pods/f85f7f1d-ca81-46a4-9a32-c763832f902d/volumes" Jul 01 22:44:26.521149 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521115 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bb8dcc7cd-x8hxq"] Jul 01 22:44:26.521552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521525 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85f7f1d-ca81-46a4-9a32-c763832f902d" containerName="authorino" Jul 01 22:44:26.521552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521538 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85f7f1d-ca81-46a4-9a32-c763832f902d" containerName="authorino" Jul 01 22:44:26.521552 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521549 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9150069d-05dd-4deb-8a62-e34c645722ec" containerName="authorino" Jul 01 22:44:26.521678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521556 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9150069d-05dd-4deb-8a62-e34c645722ec" containerName="authorino" Jul 01 22:44:26.521678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521579 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce090c76-426f-435d-b4e4-c367e77554e4" containerName="authorino" Jul 01 22:44:26.521678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521585 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce090c76-426f-435d-b4e4-c367e77554e4" containerName="authorino" Jul 01 22:44:26.521678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521642 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9150069d-05dd-4deb-8a62-e34c645722ec" containerName="authorino" Jul 01 22:44:26.521678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521655 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85f7f1d-ca81-46a4-9a32-c763832f902d" containerName="authorino" Jul 01 22:44:26.521678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.521664 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce090c76-426f-435d-b4e4-c367e77554e4" containerName="authorino" Jul 01 22:44:26.524536 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.524519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:26.527687 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.527665 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 22:44:26.528624 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.528608 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-58k5q\"" Jul 01 22:44:26.528710 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.528693 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 22:44:26.535714 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.535682 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bb8dcc7cd-x8hxq"] Jul 01 22:44:26.601475 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.601441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn9dn\" (UniqueName: \"kubernetes.io/projected/8951c5e6-ffa4-49a1-801b-d631a5128b28-kube-api-access-wn9dn\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:26.601617 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.601492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:26.680155 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.680119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77cfd54b5-jtxsz"] Jul 01 22:44:26.682472 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.682455 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:26.702902 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.702871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn9dn\" (UniqueName: \"kubernetes.io/projected/8951c5e6-ffa4-49a1-801b-d631a5128b28-kube-api-access-wn9dn\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:26.703063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.702916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2llc\" (UniqueName: \"kubernetes.io/projected/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-kube-api-access-f2llc\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:26.703063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.702962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-webhook-cert\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:26.703063 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.703001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:26.703230 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:26.703106 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 01 22:44:26.703230 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.703121 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77cfd54b5-jtxsz"] Jul 01 22:44:26.703230 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:26.703180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert podName:8951c5e6-ffa4-49a1-801b-d631a5128b28 nodeName:}" failed. No retries permitted until 2026-07-01 22:44:27.203159247 +0000 UTC m=+481.826532781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert") pod "maas-controller-5bb8dcc7cd-x8hxq" (UID: "8951c5e6-ffa4-49a1-801b-d631a5128b28") : secret "maas-controller-webhook-cert" not found Jul 01 22:44:26.712751 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.712727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn9dn\" (UniqueName: \"kubernetes.io/projected/8951c5e6-ffa4-49a1-801b-d631a5128b28-kube-api-access-wn9dn\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:26.804532 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.804443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2llc\" (UniqueName: \"kubernetes.io/projected/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-kube-api-access-f2llc\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:26.804532 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.804491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-webhook-cert\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:26.804774 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:26.804753 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 01 22:44:26.804836 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:26.804825 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-webhook-cert podName:3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e nodeName:}" failed. No retries permitted until 2026-07-01 22:44:27.304804664 +0000 UTC m=+481.928178213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-webhook-cert") pod "maas-controller-77cfd54b5-jtxsz" (UID: "3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e") : secret "maas-controller-webhook-cert" not found Jul 01 22:44:26.813665 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:26.813642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2llc\" (UniqueName: \"kubernetes.io/projected/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-kube-api-access-f2llc\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:27.206891 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.206862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:27.209242 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.209219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert\") pod \"maas-controller-5bb8dcc7cd-x8hxq\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:27.308111 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.308080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-webhook-cert\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:27.310351 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.310331 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e-webhook-cert\") pod \"maas-controller-77cfd54b5-jtxsz\" (UID: \"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e\") " pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:27.435611 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.435577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:27.592302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.592262 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:27.720789 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.720764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77cfd54b5-jtxsz"] Jul 01 22:44:27.723229 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:44:27.723204 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c41ea3a_9d0c_4e5c_bdcd_693210b55f3e.slice/crio-880fe6cfcf178a8e7ed655e36372b1761d2d999fa8c36e8b8f9d3b7a9f3c2dd9 WatchSource:0}: Error finding container 880fe6cfcf178a8e7ed655e36372b1761d2d999fa8c36e8b8f9d3b7a9f3c2dd9: Status 404 returned error can't find the container with id 880fe6cfcf178a8e7ed655e36372b1761d2d999fa8c36e8b8f9d3b7a9f3c2dd9 Jul 01 22:44:27.774484 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:27.774460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bb8dcc7cd-x8hxq"] Jul 01 22:44:27.776636 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:44:27.776615 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8951c5e6_ffa4_49a1_801b_d631a5128b28.slice/crio-4f08deba7de0636b014999b059190c322a5faadac41b2163381824148c080cb2 WatchSource:0}: Error finding container 4f08deba7de0636b014999b059190c322a5faadac41b2163381824148c080cb2: Status 404 returned error can't find the container with id 4f08deba7de0636b014999b059190c322a5faadac41b2163381824148c080cb2 Jul 01 22:44:28.197832 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:28.197796 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" event={"ID":"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e","Type":"ContainerStarted","Data":"880fe6cfcf178a8e7ed655e36372b1761d2d999fa8c36e8b8f9d3b7a9f3c2dd9"} Jul 01 22:44:28.198855 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:28.198833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" event={"ID":"8951c5e6-ffa4-49a1-801b-d631a5128b28","Type":"ContainerStarted","Data":"4f08deba7de0636b014999b059190c322a5faadac41b2163381824148c080cb2"} Jul 01 22:44:31.219016 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:31.218978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" event={"ID":"3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e","Type":"ContainerStarted","Data":"fba284f6f6474c8b737450e5cb2c92463aa6c7bbd8a7bc2cf40b0ebe8a54cc6f"} Jul 01 22:44:31.219491 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:31.219070 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:31.220535 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:31.220512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" event={"ID":"8951c5e6-ffa4-49a1-801b-d631a5128b28","Type":"ContainerStarted","Data":"211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a"} Jul 01 22:44:31.220620 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:31.220570 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:31.239854 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:31.239813 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" podStartSLOduration=2.552571443 podStartE2EDuration="5.239798186s" totalImagesPullingTime="2.687226743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:44:31.238452448 +0000 UTC m=+485.861826003" watchObservedRunningTime="2026-07-01 22:44:31.239798186 +0000 UTC m=+485.863171716" Jul 01 22:44:31.267202 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:31.267158 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" podStartSLOduration=2.622634166 podStartE2EDuration="5.267144058s" totalImagesPullingTime="2.644509892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:44:31.265183706 +0000 UTC m=+485.888557257" watchObservedRunningTime="2026-07-01 22:44:31.267144058 +0000 UTC m=+485.890517620" Jul 01 22:44:42.231052 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.231021 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:42.231513 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.231313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77cfd54b5-jtxsz" Jul 01 22:44:42.301036 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.300997 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bb8dcc7cd-x8hxq"] Jul 01 22:44:42.301263 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.301222 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" podUID="8951c5e6-ffa4-49a1-801b-d631a5128b28" containerName="manager" containerID="cri-o://211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a" gracePeriod=30 Jul 01 22:44:42.547148 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.547126 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:42.649718 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.649681 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn9dn\" (UniqueName: \"kubernetes.io/projected/8951c5e6-ffa4-49a1-801b-d631a5128b28-kube-api-access-wn9dn\") pod \"8951c5e6-ffa4-49a1-801b-d631a5128b28\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " Jul 01 22:44:42.649878 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.649750 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert\") pod \"8951c5e6-ffa4-49a1-801b-d631a5128b28\" (UID: \"8951c5e6-ffa4-49a1-801b-d631a5128b28\") " Jul 01 22:44:42.652006 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.651920 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8951c5e6-ffa4-49a1-801b-d631a5128b28" (UID: "8951c5e6-ffa4-49a1-801b-d631a5128b28"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:44:42.652006 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.651988 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8951c5e6-ffa4-49a1-801b-d631a5128b28-kube-api-access-wn9dn" (OuterVolumeSpecName: "kube-api-access-wn9dn") pod "8951c5e6-ffa4-49a1-801b-d631a5128b28" (UID: "8951c5e6-ffa4-49a1-801b-d631a5128b28"). InnerVolumeSpecName "kube-api-access-wn9dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:44:42.751430 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.751398 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn9dn\" (UniqueName: \"kubernetes.io/projected/8951c5e6-ffa4-49a1-801b-d631a5128b28-kube-api-access-wn9dn\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:44:42.751430 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:42.751425 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8951c5e6-ffa4-49a1-801b-d631a5128b28-webhook-cert\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:44:43.279007 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.278975 2579 generic.go:356] "Generic (PLEG): container finished" podID="8951c5e6-ffa4-49a1-801b-d631a5128b28" containerID="211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a" exitCode=0 Jul 01 22:44:43.279392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.279019 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" Jul 01 22:44:43.279392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.279045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" event={"ID":"8951c5e6-ffa4-49a1-801b-d631a5128b28","Type":"ContainerDied","Data":"211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a"} Jul 01 22:44:43.279392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.279084 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb8dcc7cd-x8hxq" event={"ID":"8951c5e6-ffa4-49a1-801b-d631a5128b28","Type":"ContainerDied","Data":"4f08deba7de0636b014999b059190c322a5faadac41b2163381824148c080cb2"} Jul 01 22:44:43.279392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.279106 2579 scope.go:117] "RemoveContainer" containerID="211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a" Jul 01 22:44:43.288495 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.288475 2579 scope.go:117] "RemoveContainer" containerID="211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a" Jul 01 22:44:43.288756 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:44:43.288739 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a\": container with ID starting with 211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a not found: ID does not exist" containerID="211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a" Jul 01 22:44:43.288803 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.288765 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a"} err="failed to get container status \"211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a\": rpc error: code = NotFound desc = could not find container \"211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a\": container with ID starting with 211a681479d7f97b24bdd2a44539b70317972b9606a1a5adb1c9cd1aed4bc22a not found: ID does not exist" Jul 01 22:44:43.300562 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.300531 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bb8dcc7cd-x8hxq"] Jul 01 22:44:43.307970 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.307944 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bb8dcc7cd-x8hxq"] Jul 01 22:44:43.785691 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:44:43.785663 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8951c5e6-ffa4-49a1-801b-d631a5128b28" path="/var/lib/kubelet/pods/8951c5e6-ffa4-49a1-801b-d631a5128b28/volumes" Jul 01 22:45:03.785840 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.785808 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-fb7cd86d8-rcbzz"] Jul 01 22:45:03.786258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.786209 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8951c5e6-ffa4-49a1-801b-d631a5128b28" containerName="manager" Jul 01 22:45:03.786258 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.786221 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8951c5e6-ffa4-49a1-801b-d631a5128b28" containerName="manager" Jul 01 22:45:03.786334 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.786285 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8951c5e6-ffa4-49a1-801b-d631a5128b28" containerName="manager" Jul 01 22:45:03.790679 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.790660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.795261 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.795244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vwr5c\"" Jul 01 22:45:03.795651 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.795637 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 22:45:03.810678 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.810655 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-fb7cd86d8-rcbzz"] Jul 01 22:45:03.835741 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.835713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3fbae77-e52d-4fde-9092-520b4597eef7-maas-api-tls\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.835889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.835764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3fbae77-e52d-4fde-9092-520b4597eef7-openshift-service-ca\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.835889 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.835797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzrn7\" (UniqueName: \"kubernetes.io/projected/c3fbae77-e52d-4fde-9092-520b4597eef7-kube-api-access-tzrn7\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.936275 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.936247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3fbae77-e52d-4fde-9092-520b4597eef7-openshift-service-ca\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.936426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.936283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrn7\" (UniqueName: \"kubernetes.io/projected/c3fbae77-e52d-4fde-9092-520b4597eef7-kube-api-access-tzrn7\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.936426 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.936407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3fbae77-e52d-4fde-9092-520b4597eef7-maas-api-tls\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.936953 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.936914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3fbae77-e52d-4fde-9092-520b4597eef7-openshift-service-ca\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.938721 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.938692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3fbae77-e52d-4fde-9092-520b4597eef7-maas-api-tls\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:03.945072 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:03.945046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzrn7\" (UniqueName: \"kubernetes.io/projected/c3fbae77-e52d-4fde-9092-520b4597eef7-kube-api-access-tzrn7\") pod \"maas-api-fb7cd86d8-rcbzz\" (UID: \"c3fbae77-e52d-4fde-9092-520b4597eef7\") " pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:04.101137 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.101090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:04.239441 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.239412 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-fb7cd86d8-rcbzz"] Jul 01 22:45:04.241914 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:45:04.241889 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fbae77_e52d_4fde_9092_520b4597eef7.slice/crio-b8bb5c65d32014d0b390f99254aba44b223b92cf0c707086e3713af4258d0173 WatchSource:0}: Error finding container b8bb5c65d32014d0b390f99254aba44b223b92cf0c707086e3713af4258d0173: Status 404 returned error can't find the container with id b8bb5c65d32014d0b390f99254aba44b223b92cf0c707086e3713af4258d0173 Jul 01 22:45:04.380713 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.380624 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" event={"ID":"c3fbae77-e52d-4fde-9092-520b4597eef7","Type":"ContainerStarted","Data":"b8bb5c65d32014d0b390f99254aba44b223b92cf0c707086e3713af4258d0173"} Jul 01 22:45:04.386034 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.386008 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq"] Jul 01 22:45:04.389206 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.389184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.391730 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.391712 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 22:45:04.391833 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.391734 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jrz98\"" Jul 01 22:45:04.400151 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.400127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq"] Jul 01 22:45:04.440379 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.440347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24dcbfee-235a-4e50-9bdd-935c07d5180d-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-86gsq\" (UID: \"24dcbfee-235a-4e50-9bdd-935c07d5180d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.440528 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.440416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhtqk\" (UniqueName: \"kubernetes.io/projected/24dcbfee-235a-4e50-9bdd-935c07d5180d-kube-api-access-vhtqk\") pod \"payload-pre-processing-59f49fd4f6-86gsq\" (UID: \"24dcbfee-235a-4e50-9bdd-935c07d5180d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.541305 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.541263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhtqk\" (UniqueName: \"kubernetes.io/projected/24dcbfee-235a-4e50-9bdd-935c07d5180d-kube-api-access-vhtqk\") pod \"payload-pre-processing-59f49fd4f6-86gsq\" (UID: \"24dcbfee-235a-4e50-9bdd-935c07d5180d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.541475 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.541415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24dcbfee-235a-4e50-9bdd-935c07d5180d-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-86gsq\" (UID: \"24dcbfee-235a-4e50-9bdd-935c07d5180d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.542316 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.542294 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24dcbfee-235a-4e50-9bdd-935c07d5180d-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-86gsq\" (UID: \"24dcbfee-235a-4e50-9bdd-935c07d5180d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.549913 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.549889 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhtqk\" (UniqueName: \"kubernetes.io/projected/24dcbfee-235a-4e50-9bdd-935c07d5180d-kube-api-access-vhtqk\") pod \"payload-pre-processing-59f49fd4f6-86gsq\" (UID: \"24dcbfee-235a-4e50-9bdd-935c07d5180d\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.700509 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.700420 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:04.827736 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:04.827712 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq"] Jul 01 22:45:05.386895 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:05.386856 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" event={"ID":"24dcbfee-235a-4e50-9bdd-935c07d5180d","Type":"ContainerStarted","Data":"3761618d8e764c59029c729b433ae517ca8fa496bcc0862d006289dae3d491d7"} Jul 01 22:45:06.397490 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:06.397437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" event={"ID":"c3fbae77-e52d-4fde-9092-520b4597eef7","Type":"ContainerStarted","Data":"fb3e67a4ff931ddaf86c02be30b1472e22cc184e17631589c8d269346870b211"} Jul 01 22:45:06.397991 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:06.397588 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:06.414564 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:06.414507 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" podStartSLOduration=1.638286199 podStartE2EDuration="3.414490625s" totalImagesPullingTime="1.776204426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:45:06.413062151 +0000 UTC m=+521.036435704" watchObservedRunningTime="2026-07-01 22:45:06.414490625 +0000 UTC m=+521.037864202" Jul 01 22:45:07.403766 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:07.403735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" event={"ID":"24dcbfee-235a-4e50-9bdd-935c07d5180d","Type":"ContainerStarted","Data":"280dbe6e2c609345bcf8b6006faf89fb27514430874d33e20cb490aeccbf6a69"} Jul 01 22:45:07.404375 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:07.403912 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:07.448243 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:07.448194 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" podStartSLOduration=1.05297868 podStartE2EDuration="3.448176699s" totalImagesPullingTime="2.395198019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:45:07.445917376 +0000 UTC m=+522.069290933" watchObservedRunningTime="2026-07-01 22:45:07.448176699 +0000 UTC m=+522.071550251" Jul 01 22:45:12.408774 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:12.408744 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-fb7cd86d8-rcbzz" Jul 01 22:45:14.388640 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:14.388609 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:45:14.389181 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:14.388838 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" containerID="cri-o://4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d" gracePeriod=30 Jul 01 22:45:16.039987 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.039960 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.149151 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.149119 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gn6c\" (UniqueName: \"kubernetes.io/projected/9a241051-0b74-470e-814b-d3b8ee82ad3e-kube-api-access-2gn6c\") pod \"9a241051-0b74-470e-814b-d3b8ee82ad3e\" (UID: \"9a241051-0b74-470e-814b-d3b8ee82ad3e\") " Jul 01 22:45:16.151172 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.151139 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a241051-0b74-470e-814b-d3b8ee82ad3e-kube-api-access-2gn6c" (OuterVolumeSpecName: "kube-api-access-2gn6c") pod "9a241051-0b74-470e-814b-d3b8ee82ad3e" (UID: "9a241051-0b74-470e-814b-d3b8ee82ad3e"). InnerVolumeSpecName "kube-api-access-2gn6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:45:16.250444 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.250412 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gn6c\" (UniqueName: \"kubernetes.io/projected/9a241051-0b74-470e-814b-d3b8ee82ad3e-kube-api-access-2gn6c\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:45:16.454033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.453927 2579 generic.go:356] "Generic (PLEG): container finished" podID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerID="4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d" exitCode=143 Jul 01 22:45:16.454033 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.453995 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.454211 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.454031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9a241051-0b74-470e-814b-d3b8ee82ad3e","Type":"ContainerDied","Data":"4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d"} Jul 01 22:45:16.454211 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.454079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9a241051-0b74-470e-814b-d3b8ee82ad3e","Type":"ContainerDied","Data":"c81718a37b34f0da1cb5c44975e33fdb52cb4d0daa8592723c475405006a835a"} Jul 01 22:45:16.454211 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.454098 2579 scope.go:117] "RemoveContainer" containerID="4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d" Jul 01 22:45:16.463971 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.463957 2579 scope.go:117] "RemoveContainer" containerID="4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d" Jul 01 22:45:16.464226 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:45:16.464209 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d\": container with ID starting with 4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d not found: ID does not exist" containerID="4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d" Jul 01 22:45:16.464279 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.464235 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d"} err="failed to get container status \"4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d\": rpc error: code = NotFound desc = could not find container \"4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d\": container with ID starting with 4c213dfaf793fe75623ce76e12155f77c760930887fb23c5c08833c45189f27d not found: ID does not exist" Jul 01 22:45:16.475890 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.475868 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:45:16.478912 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.478894 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:45:16.509991 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.509963 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:45:16.510356 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.510345 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" Jul 01 22:45:16.510403 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.510358 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" Jul 01 22:45:16.510450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.510413 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" containerName="keycloak" Jul 01 22:45:16.514613 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.514598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.517008 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.516981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 22:45:16.517238 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.517220 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 22:45:16.517312 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.517256 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 22:45:16.517312 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.517279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 22:45:16.517424 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.517321 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rz4ff\"" Jul 01 22:45:16.524652 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.524627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:45:16.552892 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.552864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpswt\" (UniqueName: \"kubernetes.io/projected/42480d94-f2df-46fe-832f-c348df4e36be-kube-api-access-wpswt\") pod \"maas-keycloak-0\" (UID: \"42480d94-f2df-46fe-832f-c348df4e36be\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.553032 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.552925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/42480d94-f2df-46fe-832f-c348df4e36be-test-realms\") pod \"maas-keycloak-0\" (UID: \"42480d94-f2df-46fe-832f-c348df4e36be\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.654248 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.654213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/42480d94-f2df-46fe-832f-c348df4e36be-test-realms\") pod \"maas-keycloak-0\" (UID: \"42480d94-f2df-46fe-832f-c348df4e36be\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.654403 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.654291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpswt\" (UniqueName: \"kubernetes.io/projected/42480d94-f2df-46fe-832f-c348df4e36be-kube-api-access-wpswt\") pod \"maas-keycloak-0\" (UID: \"42480d94-f2df-46fe-832f-c348df4e36be\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.654886 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.654867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/42480d94-f2df-46fe-832f-c348df4e36be-test-realms\") pod \"maas-keycloak-0\" (UID: \"42480d94-f2df-46fe-832f-c348df4e36be\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.663140 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.663118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpswt\" (UniqueName: \"kubernetes.io/projected/42480d94-f2df-46fe-832f-c348df4e36be-kube-api-access-wpswt\") pod \"maas-keycloak-0\" (UID: \"42480d94-f2df-46fe-832f-c348df4e36be\") " pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.825436 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.825409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:16.958466 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:16.958443 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 22:45:16.960490 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:45:16.960464 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42480d94_f2df_46fe_832f_c348df4e36be.slice/crio-627636e0651fcc481eb6ed8bcf484c73844b3bbfed1555a0737a309310e69143 WatchSource:0}: Error finding container 627636e0651fcc481eb6ed8bcf484c73844b3bbfed1555a0737a309310e69143: Status 404 returned error can't find the container with id 627636e0651fcc481eb6ed8bcf484c73844b3bbfed1555a0737a309310e69143 Jul 01 22:45:17.463050 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:17.463015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"42480d94-f2df-46fe-832f-c348df4e36be","Type":"ContainerStarted","Data":"1995fcb148b71c77188cbf4c027102ff4f6b6e7d35917459a840db8a6ee5d344"} Jul 01 22:45:17.463417 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:17.463074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"42480d94-f2df-46fe-832f-c348df4e36be","Type":"ContainerStarted","Data":"627636e0651fcc481eb6ed8bcf484c73844b3bbfed1555a0737a309310e69143"} Jul 01 22:45:17.482252 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:17.482193 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.161145069 podStartE2EDuration="1.482172131s" totalImagesPullingTime="321.027062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:45:17.481049188 +0000 UTC m=+532.104422742" watchObservedRunningTime="2026-07-01 22:45:17.482172131 +0000 UTC m=+532.105545684" Jul 01 22:45:17.785911 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:17.785875 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a241051-0b74-470e-814b-d3b8ee82ad3e" path="/var/lib/kubelet/pods/9a241051-0b74-470e-814b-d3b8ee82ad3e/volumes" Jul 01 22:45:17.826599 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:17.826559 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:17.827926 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:17.827893 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:18.414997 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:18.414964 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-86gsq" Jul 01 22:45:18.826744 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:18.826695 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:19.826687 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:19.826636 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:20.826543 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:20.826497 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:21.826094 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:21.826051 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:22.826410 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:22.826361 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:23.826600 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:23.826551 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:24.826954 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:24.826899 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:25.826574 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:25.826522 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:26.825983 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:26.825924 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:26.826471 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:26.826284 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:27.826898 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:27.826854 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:28.826344 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:28.826297 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:29.825956 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:29.825895 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 01 22:45:30.953293 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:30.953254 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:30.971778 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:30.971737 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="42480d94-f2df-46fe-832f-c348df4e36be" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 22:45:40.959568 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:40.959530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 22:45:51.695093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.695062 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54548c5dcf-g7fzq"] Jul 01 22:45:51.698563 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.698543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.701304 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.701288 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 22:45:51.715919 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.715891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54548c5dcf-g7fzq"] Jul 01 22:45:51.806330 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.806300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-tls-cert\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.806489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.806359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrpcf\" (UniqueName: \"kubernetes.io/projected/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-kube-api-access-vrpcf\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.806489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.806408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-oidc-ca\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.906999 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.906971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-tls-cert\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.907163 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.907040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrpcf\" (UniqueName: \"kubernetes.io/projected/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-kube-api-access-vrpcf\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.907163 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.907084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-oidc-ca\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.907672 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.907652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-oidc-ca\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.909335 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.909312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-tls-cert\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:51.914379 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:51.914358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrpcf\" (UniqueName: \"kubernetes.io/projected/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-kube-api-access-vrpcf\") pod \"authorino-54548c5dcf-g7fzq\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:52.011213 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.011128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:45:52.140496 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.140468 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54548c5dcf-g7fzq"] Jul 01 22:45:52.142644 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:45:52.142618 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f6cc42c_3ef2_45e6_8fc8_89a1a8630b86.slice/crio-0024ca6c19e9588a49bfa3388fd61fb72eee86bb787ce1acb9e180e0d4bfe044 WatchSource:0}: Error finding container 0024ca6c19e9588a49bfa3388fd61fb72eee86bb787ce1acb9e180e0d4bfe044: Status 404 returned error can't find the container with id 0024ca6c19e9588a49bfa3388fd61fb72eee86bb787ce1acb9e180e0d4bfe044 Jul 01 22:45:52.677310 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.677277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" event={"ID":"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86","Type":"ContainerStarted","Data":"a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7"} Jul 01 22:45:52.677310 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.677317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" event={"ID":"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86","Type":"ContainerStarted","Data":"0024ca6c19e9588a49bfa3388fd61fb72eee86bb787ce1acb9e180e0d4bfe044"} Jul 01 22:45:52.701140 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.701092 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" podStartSLOduration=1.384589642 podStartE2EDuration="1.701074783s" totalImagesPullingTime="316.485141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:45:52.698719764 +0000 UTC m=+567.322093315" watchObservedRunningTime="2026-07-01 22:45:52.701074783 +0000 UTC m=+567.324448335" Jul 01 22:45:52.753923 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.753848 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b5578bfdc-w849c"] Jul 01 22:45:52.754113 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:52.754089 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b5578bfdc-w849c" podUID="2d0e581f-e7f8-41a5-98f1-4e5025099275" containerName="authorino" containerID="cri-o://8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5" gracePeriod=30 Jul 01 22:45:53.003523 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.003494 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:45:53.118952 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.118915 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsz5t\" (UniqueName: \"kubernetes.io/projected/2d0e581f-e7f8-41a5-98f1-4e5025099275-kube-api-access-lsz5t\") pod \"2d0e581f-e7f8-41a5-98f1-4e5025099275\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " Jul 01 22:45:53.119114 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.119001 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d0e581f-e7f8-41a5-98f1-4e5025099275-tls-cert\") pod \"2d0e581f-e7f8-41a5-98f1-4e5025099275\" (UID: \"2d0e581f-e7f8-41a5-98f1-4e5025099275\") " Jul 01 22:45:53.121016 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.120987 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0e581f-e7f8-41a5-98f1-4e5025099275-kube-api-access-lsz5t" (OuterVolumeSpecName: "kube-api-access-lsz5t") pod "2d0e581f-e7f8-41a5-98f1-4e5025099275" (UID: "2d0e581f-e7f8-41a5-98f1-4e5025099275"). InnerVolumeSpecName "kube-api-access-lsz5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:45:53.129693 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.129662 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d0e581f-e7f8-41a5-98f1-4e5025099275-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2d0e581f-e7f8-41a5-98f1-4e5025099275" (UID: "2d0e581f-e7f8-41a5-98f1-4e5025099275"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:45:53.220407 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.220367 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsz5t\" (UniqueName: \"kubernetes.io/projected/2d0e581f-e7f8-41a5-98f1-4e5025099275-kube-api-access-lsz5t\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:45:53.220407 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.220400 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d0e581f-e7f8-41a5-98f1-4e5025099275-tls-cert\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:45:53.684504 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.684473 2579 generic.go:356] "Generic (PLEG): container finished" podID="2d0e581f-e7f8-41a5-98f1-4e5025099275" containerID="8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5" exitCode=0 Jul 01 22:45:53.684712 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.684522 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b5578bfdc-w849c" Jul 01 22:45:53.684712 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.684562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b5578bfdc-w849c" event={"ID":"2d0e581f-e7f8-41a5-98f1-4e5025099275","Type":"ContainerDied","Data":"8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5"} Jul 01 22:45:53.684712 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.684602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b5578bfdc-w849c" event={"ID":"2d0e581f-e7f8-41a5-98f1-4e5025099275","Type":"ContainerDied","Data":"511296e2911cdbecbe81a95a0794521c005f229bcb7b8b54b1d7ecb9f6fbd0e5"} Jul 01 22:45:53.684712 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.684622 2579 scope.go:117] "RemoveContainer" containerID="8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5" Jul 01 22:45:53.693267 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.693251 2579 scope.go:117] "RemoveContainer" containerID="8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5" Jul 01 22:45:53.693516 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:45:53.693496 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5\": container with ID starting with 8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5 not found: ID does not exist" containerID="8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5" Jul 01 22:45:53.693561 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.693527 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5"} err="failed to get container status \"8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5\": rpc error: code = NotFound desc = could not find container \"8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5\": container with ID starting with 8ca544cd22d632426f0531c29718da721cb4a3c2d1912115d44a0ba6726aacf5 not found: ID does not exist" Jul 01 22:45:53.708846 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.708819 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b5578bfdc-w849c"] Jul 01 22:45:53.711222 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.711201 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b5578bfdc-w849c"] Jul 01 22:45:53.785845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:45:53.785805 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0e581f-e7f8-41a5-98f1-4e5025099275" path="/var/lib/kubelet/pods/2d0e581f-e7f8-41a5-98f1-4e5025099275/volumes" Jul 01 22:46:17.188494 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.188464 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j"] Jul 01 22:46:17.188999 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.188927 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d0e581f-e7f8-41a5-98f1-4e5025099275" containerName="authorino" Jul 01 22:46:17.188999 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.188959 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d0e581f-e7f8-41a5-98f1-4e5025099275" containerName="authorino" Jul 01 22:46:17.189103 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.189058 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d0e581f-e7f8-41a5-98f1-4e5025099275" containerName="authorino" Jul 01 22:46:17.192571 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.192551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.197435 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.197412 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 22:46:17.198369 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.198354 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 22:46:17.198435 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.198366 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 22:46:17.198435 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.198366 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z2wgk\"" Jul 01 22:46:17.221337 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.221309 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j"] Jul 01 22:46:17.340055 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.340024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.340218 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.340076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.340218 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.340114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.340218 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.340153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.340218 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.340201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87dc49c4-1b87-438f-927a-46f3fa54d2d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.340382 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.340221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55t2s\" (UniqueName: \"kubernetes.io/projected/87dc49c4-1b87-438f-927a-46f3fa54d2d0-kube-api-access-55t2s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.441749 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.441662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.441749 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.441716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.441976 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.441795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87dc49c4-1b87-438f-927a-46f3fa54d2d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.441976 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.441825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55t2s\" (UniqueName: \"kubernetes.io/projected/87dc49c4-1b87-438f-927a-46f3fa54d2d0-kube-api-access-55t2s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.441976 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.441870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.441976 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.441962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.442183 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.442133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.442183 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.442175 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.442451 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.442427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.444271 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.444246 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87dc49c4-1b87-438f-927a-46f3fa54d2d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.444545 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.444524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87dc49c4-1b87-438f-927a-46f3fa54d2d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.456167 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.456128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55t2s\" (UniqueName: \"kubernetes.io/projected/87dc49c4-1b87-438f-927a-46f3fa54d2d0-kube-api-access-55t2s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j\" (UID: \"87dc49c4-1b87-438f-927a-46f3fa54d2d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.504089 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.504053 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:17.665829 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.665800 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j"] Jul 01 22:46:17.668254 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:46:17.668224 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dc49c4_1b87_438f_927a_46f3fa54d2d0.slice/crio-730448f36e67b1ea44c7f4a28d8e3a7209ac60f423d6804d8bcec289a5944dcd WatchSource:0}: Error finding container 730448f36e67b1ea44c7f4a28d8e3a7209ac60f423d6804d8bcec289a5944dcd: Status 404 returned error can't find the container with id 730448f36e67b1ea44c7f4a28d8e3a7209ac60f423d6804d8bcec289a5944dcd Jul 01 22:46:17.820127 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:17.820052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" event={"ID":"87dc49c4-1b87-438f-927a-46f3fa54d2d0","Type":"ContainerStarted","Data":"730448f36e67b1ea44c7f4a28d8e3a7209ac60f423d6804d8bcec289a5944dcd"} Jul 01 22:46:19.830617 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:19.830589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" event={"ID":"87dc49c4-1b87-438f-927a-46f3fa54d2d0","Type":"ContainerStarted","Data":"89a5cc2c404df5bbb9d78421a729efd9d556eddf2742cedef304ae1641eeafa6"} Jul 01 22:46:19.866324 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:19.866272 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" podStartSLOduration=1.7149775809999999 podStartE2EDuration="2.866255762s" totalImagesPullingTime="1.151278181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:46:19.863438592 +0000 UTC m=+594.486812144" watchObservedRunningTime="2026-07-01 22:46:19.866255762 +0000 UTC m=+594.489629315" Jul 01 22:46:25.763695 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:25.763667 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:46:25.767947 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:25.767913 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bj769_e19c94f3-ba11-47e2-b4e8-8af69106a41c/ovn-acl-logging/0.log" Jul 01 22:46:27.504343 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:27.504309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:27.504757 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:27.504393 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:27.516796 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:27.516767 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:46:27.889150 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:46:27.889120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j" Jul 01 22:47:12.185203 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.185166 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679"] Jul 01 22:47:12.189308 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.189288 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.192576 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.192553 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 22:47:12.201126 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.201106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679"] Jul 01 22:47:12.239471 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.239447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.239643 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.239476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.239643 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.239495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.239643 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.239592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmtq\" (UniqueName: \"kubernetes.io/projected/2f969f79-7219-477d-9a48-ae73faac3e0c-kube-api-access-8cmtq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.239643 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.239634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f969f79-7219-477d-9a48-ae73faac3e0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.239813 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.239666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341020 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.340980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341020 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341233 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341270 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmtq\" (UniqueName: \"kubernetes.io/projected/2f969f79-7219-477d-9a48-ae73faac3e0c-kube-api-access-8cmtq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341270 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f969f79-7219-477d-9a48-ae73faac3e0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341421 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341498 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341498 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.341706 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.341687 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.343311 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.343292 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f969f79-7219-477d-9a48-ae73faac3e0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.343529 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.343512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f969f79-7219-477d-9a48-ae73faac3e0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.350588 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.350568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmtq\" (UniqueName: \"kubernetes.io/projected/2f969f79-7219-477d-9a48-ae73faac3e0c-kube-api-access-8cmtq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679\" (UID: \"2f969f79-7219-477d-9a48-ae73faac3e0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.500278 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.500191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:12.633887 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.633862 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679"] Jul 01 22:47:12.635631 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:47:12.635606 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f969f79_7219_477d_9a48_ae73faac3e0c.slice/crio-1841b7808b7b42e3dc8c2c10a3db16b91bcda93e0014335075bd9b80f4e04e77 WatchSource:0}: Error finding container 1841b7808b7b42e3dc8c2c10a3db16b91bcda93e0014335075bd9b80f4e04e77: Status 404 returned error can't find the container with id 1841b7808b7b42e3dc8c2c10a3db16b91bcda93e0014335075bd9b80f4e04e77 Jul 01 22:47:12.637038 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:12.637023 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:47:13.102168 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:13.102134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" event={"ID":"2f969f79-7219-477d-9a48-ae73faac3e0c","Type":"ContainerStarted","Data":"dae8aeb47db3fb53c1a03ae98d398ce37ec741a489bb13b8022334362db24290"} Jul 01 22:47:13.102349 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:13.102199 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" event={"ID":"2f969f79-7219-477d-9a48-ae73faac3e0c","Type":"ContainerStarted","Data":"1841b7808b7b42e3dc8c2c10a3db16b91bcda93e0014335075bd9b80f4e04e77"} Jul 01 22:47:13.121529 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:13.121483 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" podStartSLOduration=0.953615285 podStartE2EDuration="1.121469366s" totalImagesPullingTime="167.854081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:47:13.119526968 +0000 UTC m=+647.742900521" watchObservedRunningTime="2026-07-01 22:47:13.121469366 +0000 UTC m=+647.744842919" Jul 01 22:47:19.984209 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:19.984168 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr"] Jul 01 22:47:19.987327 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:19.987306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:19.989520 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:19.989502 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 22:47:19.996480 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:19.996456 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr"] Jul 01 22:47:20.113225 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.113191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d10711b6-4a23-4d4e-a9da-5be15b06e2da-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.113392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.113232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.113392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.113306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzcd\" (UniqueName: \"kubernetes.io/projected/d10711b6-4a23-4d4e-a9da-5be15b06e2da-kube-api-access-7rzcd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.113392 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.113358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.113523 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.113406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.113523 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.113426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215125 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d10711b6-4a23-4d4e-a9da-5be15b06e2da-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzcd\" (UniqueName: \"kubernetes.io/projected/d10711b6-4a23-4d4e-a9da-5be15b06e2da-kube-api-access-7rzcd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215302 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215869 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215869 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215679 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215869 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215799 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.215869 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.215810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.217492 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.217464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d10711b6-4a23-4d4e-a9da-5be15b06e2da-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.217785 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.217765 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d10711b6-4a23-4d4e-a9da-5be15b06e2da-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.223030 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.223008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzcd\" (UniqueName: \"kubernetes.io/projected/d10711b6-4a23-4d4e-a9da-5be15b06e2da-kube-api-access-7rzcd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wwcvr\" (UID: \"d10711b6-4a23-4d4e-a9da-5be15b06e2da\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.298482 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.298401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:20.454283 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:20.454191 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr"] Jul 01 22:47:20.456729 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:47:20.456700 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10711b6_4a23_4d4e_a9da_5be15b06e2da.slice/crio-013d3fdfd34e61bf40139bec74905cb3897530156bbe8bc92779a2285785fc9c WatchSource:0}: Error finding container 013d3fdfd34e61bf40139bec74905cb3897530156bbe8bc92779a2285785fc9c: Status 404 returned error can't find the container with id 013d3fdfd34e61bf40139bec74905cb3897530156bbe8bc92779a2285785fc9c Jul 01 22:47:21.144489 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:21.144458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" event={"ID":"d10711b6-4a23-4d4e-a9da-5be15b06e2da","Type":"ContainerStarted","Data":"784ad5199f8072a2ff4e57fbd3934724b5a8fa884b8daaf057a4c223e9532ffc"} Jul 01 22:47:21.144862 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:21.144505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" event={"ID":"d10711b6-4a23-4d4e-a9da-5be15b06e2da","Type":"ContainerStarted","Data":"013d3fdfd34e61bf40139bec74905cb3897530156bbe8bc92779a2285785fc9c"} Jul 01 22:47:21.161418 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:21.161368 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" podStartSLOduration=2.006013443 podStartE2EDuration="2.16135156s" totalImagesPullingTime="155.338117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:47:21.160089839 +0000 UTC m=+655.783463417" watchObservedRunningTime="2026-07-01 22:47:21.16135156 +0000 UTC m=+655.784725111" Jul 01 22:47:22.501252 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:22.501206 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:22.501685 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:22.501280 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:22.520369 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:22.520337 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:23.170999 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:23.170961 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679" Jul 01 22:47:30.299171 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:30.299132 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:30.299666 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:30.299187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:30.311836 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:30.311808 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:47:31.213042 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:47:31.213016 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wwcvr" Jul 01 22:48:57.689907 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.689873 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bfff5987d-zcwwf"] Jul 01 22:48:57.693478 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.693459 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.701329 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.701303 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfff5987d-zcwwf"] Jul 01 22:48:57.851763 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.851722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f3cecc9c-2903-4141-8342-af86ca45e6c1-oidc-ca\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.851998 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.851841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnkdc\" (UniqueName: \"kubernetes.io/projected/f3cecc9c-2903-4141-8342-af86ca45e6c1-kube-api-access-tnkdc\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.851998 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.851919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3cecc9c-2903-4141-8342-af86ca45e6c1-tls-cert\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.952829 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.952747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3cecc9c-2903-4141-8342-af86ca45e6c1-tls-cert\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.952829 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.952806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f3cecc9c-2903-4141-8342-af86ca45e6c1-oidc-ca\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.953036 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.952851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnkdc\" (UniqueName: \"kubernetes.io/projected/f3cecc9c-2903-4141-8342-af86ca45e6c1-kube-api-access-tnkdc\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.953567 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.953543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f3cecc9c-2903-4141-8342-af86ca45e6c1-oidc-ca\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.955112 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.955096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3cecc9c-2903-4141-8342-af86ca45e6c1-tls-cert\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:57.960642 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:57.960623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnkdc\" (UniqueName: \"kubernetes.io/projected/f3cecc9c-2903-4141-8342-af86ca45e6c1-kube-api-access-tnkdc\") pod \"authorino-7bfff5987d-zcwwf\" (UID: \"f3cecc9c-2903-4141-8342-af86ca45e6c1\") " pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:58.005000 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:58.004970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfff5987d-zcwwf" Jul 01 22:48:58.135371 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:58.135284 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfff5987d-zcwwf"] Jul 01 22:48:58.138136 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:48:58.138114 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3cecc9c_2903_4141_8342_af86ca45e6c1.slice/crio-4a7b54a83fb915e54db70af44a1afd9e78f53beb4fcb49f25e22bd2596a2cf72 WatchSource:0}: Error finding container 4a7b54a83fb915e54db70af44a1afd9e78f53beb4fcb49f25e22bd2596a2cf72: Status 404 returned error can't find the container with id 4a7b54a83fb915e54db70af44a1afd9e78f53beb4fcb49f25e22bd2596a2cf72 Jul 01 22:48:58.633915 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:58.633884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfff5987d-zcwwf" event={"ID":"f3cecc9c-2903-4141-8342-af86ca45e6c1","Type":"ContainerStarted","Data":"4a7b54a83fb915e54db70af44a1afd9e78f53beb4fcb49f25e22bd2596a2cf72"} Jul 01 22:48:59.640845 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:59.640810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfff5987d-zcwwf" event={"ID":"f3cecc9c-2903-4141-8342-af86ca45e6c1","Type":"ContainerStarted","Data":"d277cabc26919245eab7fa6ab3dcfacc549714fb2387e504e9df22940fd11540"} Jul 01 22:48:59.671024 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:59.670961 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bfff5987d-zcwwf" podStartSLOduration=2.197583252 podStartE2EDuration="2.670921803s" totalImagesPullingTime="473.338551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:48:59.670785011 +0000 UTC m=+754.294158564" watchObservedRunningTime="2026-07-01 22:48:59.670921803 +0000 UTC m=+754.294295357" Jul 01 22:48:59.712959 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:59.712792 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54548c5dcf-g7fzq"] Jul 01 22:48:59.714162 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:59.713323 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" podUID="6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" containerName="authorino" containerID="cri-o://a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7" gracePeriod=30 Jul 01 22:48:59.978784 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:48:59.978759 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:49:00.074016 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.073987 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-tls-cert\") pod \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " Jul 01 22:49:00.074199 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.074063 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-oidc-ca\") pod \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " Jul 01 22:49:00.074199 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.074135 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrpcf\" (UniqueName: \"kubernetes.io/projected/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-kube-api-access-vrpcf\") pod \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\" (UID: \"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86\") " Jul 01 22:49:00.076680 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.076643 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-kube-api-access-vrpcf" (OuterVolumeSpecName: "kube-api-access-vrpcf") pod "6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" (UID: "6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86"). InnerVolumeSpecName "kube-api-access-vrpcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:49:00.079672 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.079644 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" (UID: "6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:49:00.086660 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.086639 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" (UID: "6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:49:00.175366 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.175332 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-tls-cert\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:49:00.175366 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.175366 2579 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-oidc-ca\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:49:00.175578 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.175380 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrpcf\" (UniqueName: \"kubernetes.io/projected/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86-kube-api-access-vrpcf\") on node \"ip-10-0-141-227.ec2.internal\" DevicePath \"\"" Jul 01 22:49:00.647264 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.647221 2579 generic.go:356] "Generic (PLEG): container finished" podID="6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" containerID="a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7" exitCode=0 Jul 01 22:49:00.647264 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.647267 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" Jul 01 22:49:00.647799 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.647304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" event={"ID":"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86","Type":"ContainerDied","Data":"a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7"} Jul 01 22:49:00.647799 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.647364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54548c5dcf-g7fzq" event={"ID":"6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86","Type":"ContainerDied","Data":"0024ca6c19e9588a49bfa3388fd61fb72eee86bb787ce1acb9e180e0d4bfe044"} Jul 01 22:49:00.647799 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.647391 2579 scope.go:117] "RemoveContainer" containerID="a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7" Jul 01 22:49:00.658812 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.658481 2579 scope.go:117] "RemoveContainer" containerID="a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7" Jul 01 22:49:00.659230 ip-10-0-141-227 kubenswrapper[2579]: E0701 22:49:00.659200 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7\": container with ID starting with a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7 not found: ID does not exist" containerID="a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7" Jul 01 22:49:00.659328 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.659237 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7"} err="failed to get container status \"a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7\": rpc error: code = NotFound desc = could not find container \"a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7\": container with ID starting with a08aa0af939b040f26f50a83d7530955656866305390a72ac592928473bb07a7 not found: ID does not exist" Jul 01 22:49:00.668863 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.668839 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54548c5dcf-g7fzq"] Jul 01 22:49:00.673382 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:00.673360 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54548c5dcf-g7fzq"] Jul 01 22:49:01.785770 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:01.785740 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" path="/var/lib/kubelet/pods/6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86/volumes" Jul 01 22:49:37.262210 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:37.262177 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bfff5987d-zcwwf_f3cecc9c-2903-4141-8342-af86ca45e6c1/authorino/0.log" Jul 01 22:49:41.899681 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:41.899654 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-fb7cd86d8-rcbzz_c3fbae77-e52d-4fde-9092-520b4597eef7/maas-api/0.log" Jul 01 22:49:42.016313 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:42.016284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77cfd54b5-jtxsz_3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e/manager/0.log" Jul 01 22:49:42.357374 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:42.357350 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-7mljv_c1d24cf2-6fd8-47c9-be7d-07fad00edaca/copy-manifests/0.log" Jul 01 22:49:42.364976 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:42.364949 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-7mljv_c1d24cf2-6fd8-47c9-be7d-07fad00edaca/manager/0.log" Jul 01 22:49:43.946507 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:43.946474 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bfff5987d-zcwwf_f3cecc9c-2903-4141-8342-af86ca45e6c1/authorino/0.log" Jul 01 22:49:44.060660 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:44.060634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7fvsp_46a68aaa-f43a-4c15-9ec7-4750be1850fe/manager/0.log" Jul 01 22:49:45.294112 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:45.294084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f8c56ffb-59dpw_ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af/kube-auth-proxy/0.log" Jul 01 22:49:45.629349 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:45.629320 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-86gsq_24dcbfee-235a-4e50-9bdd-935c07d5180d/payload-pre-processing/0.log" Jul 01 22:49:46.168628 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:46.168603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cm89j_87dc49c4-1b87-438f-927a-46f3fa54d2d0/main/0.log" Jul 01 22:49:46.490326 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:46.490253 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrs679_2f969f79-7219-477d-9a48-ae73faac3e0c/main/0.log" Jul 01 22:49:46.600668 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:46.600642 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wwcvr_d10711b6-4a23-4d4e-a9da-5be15b06e2da/main/0.log" Jul 01 22:49:53.208773 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:53.208700 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pvzbn_87cc096e-5f44-4471-bf7e-32d1c1032602/global-pull-secret-syncer/0.log" Jul 01 22:49:53.282989 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:53.282962 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nm7bc_edb0714f-f44d-48d5-836c-198f20121771/konnectivity-agent/0.log" Jul 01 22:49:53.377947 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:53.377909 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-227.ec2.internal_380076dd55b07509cfcb1ff3be99347f/haproxy/0.log" Jul 01 22:49:57.964422 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:57.964392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bfff5987d-zcwwf_f3cecc9c-2903-4141-8342-af86ca45e6c1/authorino/0.log" Jul 01 22:49:57.992585 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:57.992515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7fvsp_46a68aaa-f43a-4c15-9ec7-4750be1850fe/manager/0.log" Jul 01 22:49:59.980698 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:49:59.980673 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/alertmanager/0.log" Jul 01 22:50:00.006989 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.006965 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/config-reloader/0.log" Jul 01 22:50:00.036559 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.036534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/kube-rbac-proxy-web/0.log" Jul 01 22:50:00.060954 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.060914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/kube-rbac-proxy/0.log" Jul 01 22:50:00.092077 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.092043 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/kube-rbac-proxy-metric/0.log" Jul 01 22:50:00.119583 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.119553 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/prom-label-proxy/0.log" Jul 01 22:50:00.145738 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.145718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55a2d94a-ab8f-4500-9d22-ee7fafa1ba1f/init-config-reloader/0.log" Jul 01 22:50:00.223153 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.223075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-r92n4_2a4574dc-691d-4756-8b8d-97efd6549462/kube-state-metrics/0.log" Jul 01 22:50:00.246474 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.246454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-r92n4_2a4574dc-691d-4756-8b8d-97efd6549462/kube-rbac-proxy-main/0.log" Jul 01 22:50:00.271696 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.271673 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-r92n4_2a4574dc-691d-4756-8b8d-97efd6549462/kube-rbac-proxy-self/0.log" Jul 01 22:50:00.303398 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.303354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-665ff8b76d-trcns_2755383e-e361-4d65-b96b-afc92f0b1bbc/metrics-server/0.log" Jul 01 22:50:00.333682 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.333657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-d8t77_e8a1e6eb-5aaa-49bb-8f8b-7b90df2d8820/monitoring-plugin/0.log" Jul 01 22:50:00.453866 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.453829 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqchb_f1926b7d-0ba4-4efb-8511-ecf9e075f906/node-exporter/0.log" Jul 01 22:50:00.482888 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.482833 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqchb_f1926b7d-0ba4-4efb-8511-ecf9e075f906/kube-rbac-proxy/0.log" Jul 01 22:50:00.515101 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.515081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqchb_f1926b7d-0ba4-4efb-8511-ecf9e075f906/init-textfile/0.log" Jul 01 22:50:00.651010 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.650986 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-drvfw_11503719-180e-4a11-8777-5cfc6e00983f/kube-rbac-proxy-main/0.log" Jul 01 22:50:00.678016 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.677992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-drvfw_11503719-180e-4a11-8777-5cfc6e00983f/kube-rbac-proxy-self/0.log" Jul 01 22:50:00.705107 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.705081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-drvfw_11503719-180e-4a11-8777-5cfc6e00983f/openshift-state-metrics/0.log" Jul 01 22:50:00.745871 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.745805 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/prometheus/0.log" Jul 01 22:50:00.770450 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.770430 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/config-reloader/0.log" Jul 01 22:50:00.795136 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.795110 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/thanos-sidecar/0.log" Jul 01 22:50:00.819238 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.819221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/kube-rbac-proxy-web/0.log" Jul 01 22:50:00.843093 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.843068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/kube-rbac-proxy/0.log" Jul 01 22:50:00.865076 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.865055 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/kube-rbac-proxy-thanos/0.log" Jul 01 22:50:00.888243 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.888224 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_29ee3090-32c7-40fe-b458-c77533bf8e34/init-config-reloader/0.log" Jul 01 22:50:00.920972 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.920951 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-lgt9c_c936a78f-eb31-4a5b-b0e4-7b05e5837c06/prometheus-operator/0.log" Jul 01 22:50:00.944109 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:00.944085 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-lgt9c_c936a78f-eb31-4a5b-b0e4-7b05e5837c06/kube-rbac-proxy/0.log" Jul 01 22:50:01.002368 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.002297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6549c76bc9-clp7r_8d140503-e82c-44f8-aa6e-a8a4de24fca5/telemeter-client/0.log" Jul 01 22:50:01.027792 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.027770 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6549c76bc9-clp7r_8d140503-e82c-44f8-aa6e-a8a4de24fca5/reload/0.log" Jul 01 22:50:01.052645 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.052626 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6549c76bc9-clp7r_8d140503-e82c-44f8-aa6e-a8a4de24fca5/kube-rbac-proxy/0.log" Jul 01 22:50:01.092842 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.092818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865b7c964b-b4vdq_5f29056e-c37b-4f40-b208-f9bbfa8105a5/thanos-query/0.log" Jul 01 22:50:01.115338 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.115316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865b7c964b-b4vdq_5f29056e-c37b-4f40-b208-f9bbfa8105a5/kube-rbac-proxy-web/0.log" Jul 01 22:50:01.136739 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.136719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865b7c964b-b4vdq_5f29056e-c37b-4f40-b208-f9bbfa8105a5/kube-rbac-proxy/0.log" Jul 01 22:50:01.158543 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.158523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865b7c964b-b4vdq_5f29056e-c37b-4f40-b208-f9bbfa8105a5/prom-label-proxy/0.log" Jul 01 22:50:01.180085 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.180068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865b7c964b-b4vdq_5f29056e-c37b-4f40-b208-f9bbfa8105a5/kube-rbac-proxy-rules/0.log" Jul 01 22:50:01.205836 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:01.205814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865b7c964b-b4vdq_5f29056e-c37b-4f40-b208-f9bbfa8105a5/kube-rbac-proxy-metrics/0.log" Jul 01 22:50:03.529526 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.529493 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf"] Jul 01 22:50:03.530008 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.529976 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" containerName="authorino" Jul 01 22:50:03.530008 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.529989 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" containerName="authorino" Jul 01 22:50:03.530103 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.530088 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6cc42c-3ef2-45e6-8fc8-89a1a8630b86" containerName="authorino" Jul 01 22:50:03.533395 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.533375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.535493 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.535475 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjf5b\"/\"kube-root-ca.crt\"" Jul 01 22:50:03.536358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.536339 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjf5b\"/\"openshift-service-ca.crt\"" Jul 01 22:50:03.536358 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.536349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjf5b\"/\"default-dockercfg-72vmj\"" Jul 01 22:50:03.539805 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.539783 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf"] Jul 01 22:50:03.569664 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.569637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-proc\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.569804 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.569719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-lib-modules\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.569804 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.569749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-podres\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.569884 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.569829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2z5\" (UniqueName: \"kubernetes.io/projected/5cfe2121-fc7b-4693-b413-87fed80cb60c-kube-api-access-pf2z5\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.569884 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.569875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-sys\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.625398 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.625367 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-v5c82_ec8ed306-9fa0-4ed3-a432-d5341092f236/download-server/0.log" Jul 01 22:50:03.671066 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-sys\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671066 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-proc\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-lib-modules\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-podres\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-sys\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2z5\" (UniqueName: \"kubernetes.io/projected/5cfe2121-fc7b-4693-b413-87fed80cb60c-kube-api-access-pf2z5\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-lib-modules\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-podres\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.671320 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.671275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5cfe2121-fc7b-4693-b413-87fed80cb60c-proc\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.679182 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.679156 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2z5\" (UniqueName: \"kubernetes.io/projected/5cfe2121-fc7b-4693-b413-87fed80cb60c-kube-api-access-pf2z5\") pod \"perf-node-gather-daemonset-djsnf\" (UID: \"5cfe2121-fc7b-4693-b413-87fed80cb60c\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.845550 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.845527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:03.973445 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:03.973421 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf"] Jul 01 22:50:03.975267 ip-10-0-141-227 kubenswrapper[2579]: W0701 22:50:03.975239 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5cfe2121_fc7b_4693_b413_87fed80cb60c.slice/crio-38bc1d0d8bfa23c5f2b56c79ed4dbbb4d2d796cab570a756b5696dfd63e31af7 WatchSource:0}: Error finding container 38bc1d0d8bfa23c5f2b56c79ed4dbbb4d2d796cab570a756b5696dfd63e31af7: Status 404 returned error can't find the container with id 38bc1d0d8bfa23c5f2b56c79ed4dbbb4d2d796cab570a756b5696dfd63e31af7 Jul 01 22:50:04.966824 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:04.966796 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" event={"ID":"5cfe2121-fc7b-4693-b413-87fed80cb60c","Type":"ContainerStarted","Data":"66b8cd40dedac020fbf113b3eb4802331202fb655ebde4e0bb31be296e18dc0a"} Jul 01 22:50:04.967214 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:04.966843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" event={"ID":"5cfe2121-fc7b-4693-b413-87fed80cb60c","Type":"ContainerStarted","Data":"38bc1d0d8bfa23c5f2b56c79ed4dbbb4d2d796cab570a756b5696dfd63e31af7"} Jul 01 22:50:04.967214 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:04.966894 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:04.983328 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:04.983285 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" podStartSLOduration=1.983270128 podStartE2EDuration="1.983270128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:50:04.981724036 +0000 UTC m=+819.605097589" watchObservedRunningTime="2026-07-01 22:50:04.983270128 +0000 UTC m=+819.606643692" Jul 01 22:50:05.398056 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:05.398032 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdhhh_31011703-db12-46b0-8530-416afc7ec29d/dns/0.log" Jul 01 22:50:05.422606 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:05.422570 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdhhh_31011703-db12-46b0-8530-416afc7ec29d/kube-rbac-proxy/0.log" Jul 01 22:50:05.469431 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:05.469401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q4szn_ca4fa93a-08d5-41fc-ad68-8dc4671b0e79/dns-node-resolver/0.log" Jul 01 22:50:06.166891 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:06.166864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j7td8_9bce97ef-3fee-453a-b1a1-cd2da6b6445e/node-ca/0.log" Jul 01 22:50:07.295462 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:07.295434 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f8c56ffb-59dpw_ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af/kube-auth-proxy/0.log" Jul 01 22:50:07.380219 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:07.380189 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-86gsq_24dcbfee-235a-4e50-9bdd-935c07d5180d/payload-pre-processing/0.log" Jul 01 22:50:08.067905 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:08.067877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-px26w_20ddf595-4e4d-4706-ae97-b5e6042484cb/serve-healthcheck-canary/0.log" Jul 01 22:50:08.919085 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:08.919059 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-snprw_ba13ad38-1737-497b-b48e-86d657924bc0/kube-rbac-proxy/0.log" Jul 01 22:50:08.957752 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:08.957728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-snprw_ba13ad38-1737-497b-b48e-86d657924bc0/exporter/0.log" Jul 01 22:50:08.997082 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:08.997057 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-snprw_ba13ad38-1737-497b-b48e-86d657924bc0/extractor/0.log" Jul 01 22:50:10.981092 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:10.981060 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-djsnf" Jul 01 22:50:11.215781 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:11.215753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-fb7cd86d8-rcbzz_c3fbae77-e52d-4fde-9092-520b4597eef7/maas-api/0.log" Jul 01 22:50:11.245755 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:11.245677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77cfd54b5-jtxsz_3c41ea3a-9d0c-4e5c-bdcd-693210b55f3e/manager/0.log" Jul 01 22:50:11.344616 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:11.344589 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-7mljv_c1d24cf2-6fd8-47c9-be7d-07fad00edaca/manager/0.log" Jul 01 22:50:11.366977 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:11.366950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-7mljv_c1d24cf2-6fd8-47c9-be7d-07fad00edaca/copy-manifests/0.log" Jul 01 22:50:13.052025 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:13.051992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bb7dc95cc-mwf9j_70d95fac-6321-48f1-a4a2-7a6300b781e1/manager/0.log" Jul 01 22:50:13.084357 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:13.084328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qmn92_06eadab1-9d25-4ac9-8f45-38387ed12f72/openshift-lws-operator/0.log" Jul 01 22:50:13.440118 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:13.440093 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f8c56ffb-59dpw_ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af/kube-auth-proxy/0.log" Jul 01 22:50:13.489342 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:13.489319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-86gsq_24dcbfee-235a-4e50-9bdd-935c07d5180d/payload-pre-processing/0.log" Jul 01 22:50:14.635535 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:14.635509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f8c56ffb-59dpw_ab3adb2a-d3dd-46db-8ddd-b514a4e7f0af/kube-auth-proxy/0.log" Jul 01 22:50:14.694713 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:14.694693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-86gsq_24dcbfee-235a-4e50-9bdd-935c07d5180d/payload-pre-processing/0.log" Jul 01 22:50:19.816508 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.816479 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/kube-multus-additional-cni-plugins/0.log" Jul 01 22:50:19.839046 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.839019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/egress-router-binary-copy/0.log" Jul 01 22:50:19.861992 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.861972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/cni-plugins/0.log" Jul 01 22:50:19.886422 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.886401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/bond-cni-plugin/0.log" Jul 01 22:50:19.909164 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.909145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/routeoverride-cni/0.log" Jul 01 22:50:19.931662 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.931640 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/whereabouts-cni-bincopy/0.log" Jul 01 22:50:19.953795 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:19.953722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxgtb_6026a364-be43-4ba4-95f6-9efd779d2e1f/whereabouts-cni/0.log" Jul 01 22:50:20.162417 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:20.162393 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cmg72_09e52e9b-d950-4e11-b03a-22e08ce784ae/kube-multus/0.log" Jul 01 22:50:20.238768 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:20.238697 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkh8w_8523b2c4-6c90-4eaf-8065-8b151ebe64c1/network-metrics-daemon/0.log" Jul 01 22:50:20.261562 ip-10-0-141-227 kubenswrapper[2579]: I0701 22:50:20.261539 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkh8w_8523b2c4-6c90-4eaf-8065-8b151ebe64c1/kube-rbac-proxy/0.log"