Jun 10 01:00:59.305210 ip-10-0-131-207 systemd[1]: Starting Kubernetes Kubelet... Jun 10 01:00:59.701436 ip-10-0-131-207 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:00:59.701436 ip-10-0-131-207 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 01:00:59.701436 ip-10-0-131-207 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:00:59.701436 ip-10-0-131-207 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 01:00:59.701436 ip-10-0-131-207 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:00:59.703219 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.703135 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707598 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707615 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707619 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707622 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707626 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707629 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707632 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:59.707624 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707635 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707638 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707641 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707644 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707647 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707650 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707653 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707663 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707666 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707669 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707671 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707674 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707677 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707680 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707682 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707685 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707688 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707691 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707693 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707696 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:59.707910 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707698 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707701 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707703 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707706 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707708 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707711 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707713 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707716 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707720 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707724 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707727 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707730 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707732 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707735 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707738 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707741 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707743 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707746 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707748 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707751 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:59.708379 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707754 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707756 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707759 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707761 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707764 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707766 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707768 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707771 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707774 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707776 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707779 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707781 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707783 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707786 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707788 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707791 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707793 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707796 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707798 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:59.708891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707801 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707803 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707806 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707809 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707811 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707813 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707817 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707820 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707825 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707829 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707832 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707835 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707838 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707841 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707843 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707847 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707850 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707853 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707855 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:59.709353 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707858 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707860 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707863 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707865 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707868 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707870 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707884 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707886 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707889 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707892 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707894 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707897 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707900 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.707902 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708612 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708619 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708622 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708625 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708627 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708632 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:59.709825 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708637 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708640 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708643 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708645 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708650 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708654 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708657 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708661 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708664 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708667 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708670 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708672 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708675 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708678 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708680 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708683 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708686 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708690 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708692 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:59.710405 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708695 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708699 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708702 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708705 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708708 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708711 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708713 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708716 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708718 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708721 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708723 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708726 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708728 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708732 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708735 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708738 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708741 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708743 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708746 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708748 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:59.710936 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708751 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708754 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708756 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708759 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708761 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708764 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708766 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708769 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708771 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708774 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708776 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708780 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708782 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708785 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708787 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708790 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708792 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708795 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708798 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708801 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:59.711427 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708803 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708806 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708808 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708811 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708813 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708815 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708819 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708821 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708825 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708827 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708829 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708832 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708835 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708837 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708840 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708842 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708845 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708847 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708850 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708852 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:59.711966 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708854 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708857 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708860 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708862 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708865 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708867 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708870 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708886 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708888 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708891 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708895 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708897 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708900 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.708903 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709319 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709325 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709329 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709332 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709336 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709339 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:59.712460 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709342 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709345 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709348 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709351 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709353 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709356 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709360 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709363 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709366 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709368 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709371 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709373 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709376 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709378 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709381 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709383 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709386 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709388 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709391 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709393 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:59.712971 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709396 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709399 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709401 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709404 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709407 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709409 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709412 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709414 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709417 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709419 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709422 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709425 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709427 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709430 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709432 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709436 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709439 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709442 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709446 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709448 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:59.713448 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709451 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709454 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709456 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709459 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709463 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709466 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709469 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709472 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709475 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709477 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709480 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709482 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709485 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709487 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709493 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709495 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709498 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709500 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709503 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:59.713964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709505 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709508 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709510 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709513 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709516 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709519 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709522 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709524 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709527 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709529 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709532 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709536 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709538 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709541 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709557 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709560 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709565 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709568 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709571 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:59.714425 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709574 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709577 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709580 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709582 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709585 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709587 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709590 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709593 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709596 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709599 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709601 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709605 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709607 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709610 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.709612 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709677 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709684 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709690 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709695 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709702 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709705 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 01:00:59.714922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709709 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709713 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709716 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709720 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709724 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709727 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709730 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709733 2565 flags.go:64] FLAG: --cgroup-root="" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709736 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709739 2565 flags.go:64] FLAG: --client-ca-file="" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709742 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709745 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709749 2565 flags.go:64] FLAG: --cluster-domain="" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709752 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709755 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709758 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709762 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709765 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709768 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709773 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709777 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709779 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709782 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709786 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 01:00:59.715464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709789 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709792 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709796 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709798 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709801 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709804 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709807 2565 flags.go:64] FLAG: --enable-server="true" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709811 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709815 2565 flags.go:64] FLAG: --event-burst="100" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709819 2565 flags.go:64] FLAG: --event-qps="50" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709821 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709826 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709829 2565 flags.go:64] FLAG: --eviction-hard="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709832 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709835 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709839 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709842 2565 flags.go:64] FLAG: --eviction-soft="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709845 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709848 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709851 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709854 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709856 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709859 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709862 2565 flags.go:64] FLAG: --feature-gates="" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709865 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 01:00:59.716051 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709868 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709893 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709898 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709901 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709904 2565 flags.go:64] FLAG: --help="false" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709906 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-131-207.ec2.internal" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709910 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709913 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709916 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709919 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709922 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709925 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709928 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709930 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709933 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709937 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709940 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709943 2565 flags.go:64] FLAG: --kube-reserved="" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709947 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709949 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709952 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709955 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709958 2565 flags.go:64] FLAG: --lock-file="" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709960 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 01:00:59.716689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709963 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709966 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709971 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709974 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709977 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709979 2565 flags.go:64] FLAG: --logging-format="text" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709982 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709990 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709993 2565 flags.go:64] FLAG: --manifest-url="" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.709996 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710001 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710004 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710008 2565 flags.go:64] FLAG: --max-pods="110" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710012 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710015 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710017 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710020 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710023 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710026 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710029 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710036 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710039 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710042 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 01:00:59.717319 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710046 2565 flags.go:64] FLAG: --pod-cidr="" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710049 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710054 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710058 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710062 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710064 2565 flags.go:64] FLAG: --port="10250" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710068 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710071 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0919a27f0350f07be" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710074 2565 flags.go:64] FLAG: --qos-reserved="" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710077 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710080 2565 flags.go:64] FLAG: --register-node="true" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710083 2565 flags.go:64] FLAG: --register-with-taints="" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710086 2565 flags.go:64] FLAG: --registry-burst="10" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710089 2565 flags.go:64] FLAG: --registry-qps="5" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710092 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710094 2565 flags.go:64] FLAG: --reserved-memory="" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710098 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710101 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710104 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710107 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710110 2565 flags.go:64] FLAG: --runonce="false" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710112 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710115 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710118 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710121 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 01:00:59.717867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710124 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710127 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710130 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710133 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710135 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710138 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710141 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710144 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710147 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710150 2565 flags.go:64] FLAG: --system-cgroups="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710154 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710159 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710162 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710165 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710168 2565 flags.go:64] FLAG: --tls-min-version="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710171 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710174 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710177 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710179 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710182 2565 flags.go:64] FLAG: --v="2" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710186 2565 flags.go:64] FLAG: --version="false" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710190 2565 flags.go:64] FLAG: --vmodule="" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710194 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.710197 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710320 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:59.718505 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710324 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710327 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710330 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710333 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710336 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710339 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710341 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710344 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710346 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710349 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710352 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710354 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710357 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710359 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710362 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710364 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710367 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710374 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710377 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710379 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710382 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:59.719183 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710384 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710387 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710389 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710392 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710394 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710396 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710399 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710402 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710406 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710409 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710411 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710414 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710417 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710421 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710423 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710426 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710428 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710431 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710434 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:59.719717 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710436 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710439 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710441 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710444 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710446 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710448 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710451 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710454 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710456 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710459 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710462 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710465 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710467 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710470 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710472 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710476 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710480 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710483 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710486 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:59.720281 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710489 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710491 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710494 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710497 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710500 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710502 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710505 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710509 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710511 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710514 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710517 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710520 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710522 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710525 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710528 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710531 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710534 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710537 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710539 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710542 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:59.720760 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710545 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710547 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710550 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710552 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710555 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710558 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710560 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710563 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710565 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710567 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710570 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710572 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710574 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710577 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710580 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710582 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710584 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710587 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:59.721277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.710589 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.711462 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.718335 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.718350 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.718364 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.718370 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718428 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718433 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718437 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718440 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718443 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718445 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718448 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718451 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718453 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:59.721709 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718456 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718459 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718461 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718464 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718467 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718469 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718472 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718475 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718477 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718479 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718482 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718484 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718487 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718489 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718492 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718495 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718498 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718500 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718503 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718506 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:59.722127 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718511 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718515 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718518 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718522 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718524 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718527 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718532 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718536 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718540 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718543 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718545 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718548 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718550 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718553 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718556 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718558 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718562 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718565 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:59.722613 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718568 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718571 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718573 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718576 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718579 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718581 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718584 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718586 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718588 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718591 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718594 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718596 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718599 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718602 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718605 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718608 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718610 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718613 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718615 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:59.723098 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718618 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718620 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718623 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718625 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718627 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718630 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718633 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718635 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718638 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718640 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718642 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718645 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718648 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718650 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718653 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718655 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718658 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718660 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718663 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718665 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:59.723569 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718667 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718670 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718672 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718675 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718677 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718680 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718683 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718686 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718690 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718692 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718695 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718697 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.718702 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718828 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718834 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:59.724092 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718837 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718840 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718842 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718845 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718847 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718850 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718852 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718855 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718857 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718860 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718862 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718865 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718867 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718870 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718890 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718893 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718896 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718900 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718905 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:59.724504 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718908 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718910 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718913 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718915 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718918 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718920 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718923 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718926 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718929 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718931 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718934 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718936 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718938 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718941 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718943 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718946 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718948 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718950 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718953 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718955 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:59.724996 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718958 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718960 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718963 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718965 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718967 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718970 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718972 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718975 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718977 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718980 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718982 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718985 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718988 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718990 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718993 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718995 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.718998 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719000 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719003 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719005 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:59.725484 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719008 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719012 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719015 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719018 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719021 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719023 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719025 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719028 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719030 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719033 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719035 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719037 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719041 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719044 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719047 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719049 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719051 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719054 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719056 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:59.725985 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719059 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719061 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719067 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719070 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719072 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719075 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719078 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719080 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719083 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719085 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719088 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719091 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719093 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719096 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719098 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719101 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719104 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719106 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:59.726453 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:00:59.719109 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:59.726906 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.719114 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:00:59.726906 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.719238 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 01:00:59.726906 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.723788 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 01:00:59.726906 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.725374 2565 server.go:1019] "Starting client certificate rotation" Jun 10 01:00:59.726906 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.725480 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:00:59.726906 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.726267 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:00:59.728566 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.728550 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:00:59.735927 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.735904 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:00:59.752331 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.752307 2565 log.go:25] "Validated CRI v1 runtime API" Jun 10 01:00:59.755511 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.755493 2565 log.go:25] "Validated CRI v1 image API" Jun 10 01:00:59.755796 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.755765 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:00:59.757294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.757278 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 01:00:59.759607 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.759589 2565 fs.go:135] Filesystem UUIDs: map[2f2c9495-a02d-4aa8-be87-359856c8d2ea:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ca0e80ee-36a1-4c4d-9cae-7b321267ba22:/dev/nvme0n1p3] Jun 10 01:00:59.759659 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.759608 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 01:00:59.765079 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.764972 2565 manager.go:216] Machine: {Timestamp:2026-06-10 01:00:59.763622363 +0000 UTC m=+0.340973479 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099286 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d79387712058abb16174c2960b43a SystemUUID:ec2d7938-7712-058a-bb16-174c2960b43a BootID:8c342297-cf56-44a7-b465-633d37318af0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:64:2f:b5:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:64:2f:b5:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:a4:08:6d:ca:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 01:00:59.765079 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.765078 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 01:00:59.765205 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.765193 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 01:00:59.768590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.768564 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 01:00:59.768748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.768596 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-207.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 01:00:59.769344 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.769334 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 01:00:59.769379 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.769348 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 01:00:59.769379 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.769356 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:00:59.769949 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.769937 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:00:59.770908 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.770898 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 01:00:59.773909 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.773897 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:00:59.774028 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774019 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 01:00:59.774070 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774049 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 10 01:00:59.774070 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774061 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 01:00:59.774141 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774071 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 01:00:59.774141 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774084 2565 kubelet.go:398] "Adding apiserver pod source" Jun 10 01:00:59.774141 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774097 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 01:00:59.774444 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774432 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:00:59.774480 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.774453 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:00:59.776842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.776824 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 01:00:59.779069 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.779051 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qhwpc" Jun 10 01:00:59.779825 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.779809 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 01:00:59.779907 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.779841 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 01:00:59.780510 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780497 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780514 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780520 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780526 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780535 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780541 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780549 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780554 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780562 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780567 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780575 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 01:00:59.780593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.780581 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 01:00:59.781590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.781578 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 01:00:59.781590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.781588 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 01:00:59.785213 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.785194 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qhwpc" Jun 10 01:00:59.787089 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.787061 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-207.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 01:00:59.787218 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.787063 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 01:00:59.787218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.787118 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-207.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 01:00:59.789994 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.789976 2565 server.go:1268] "Started kubelet" Jun 10 01:00:59.790570 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.790510 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 01:00:59.790570 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.790511 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 01:00:59.790705 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.790598 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 01:00:59.791181 ip-10-0-131-207 systemd[1]: Started Kubernetes Kubelet. Jun 10 01:00:59.792251 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.792233 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 10 01:00:59.792755 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.792738 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 01:00:59.798205 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.798175 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 01:00:59.798772 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.798759 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 01:00:59.798836 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.798767 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 01:00:59.798912 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.798890 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:00:59.799096 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.798039 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-207.ec2.internal.18b79280dbd4ac7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-207.ec2.internal,UID:ip-10-0-131-207.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-207.ec2.internal,},FirstTimestamp:2026-06-10 01:00:59.789937789 +0000 UTC m=+0.367288914,LastTimestamp:2026-06-10 01:00:59.789937789 +0000 UTC m=+0.367288914,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-207.ec2.internal,}" Jun 10 01:00:59.799367 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799349 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 01:00:59.799443 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799419 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 01:00:59.799443 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799430 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 01:00:59.799538 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799532 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 10 01:00:59.799595 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799539 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 10 01:00:59.799891 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799857 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 01:00:59.799891 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799889 2565 factory.go:55] Registering systemd factory Jun 10 01:00:59.799986 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.799899 2565 factory.go:223] Registration of the systemd container factory successfully Jun 10 01:00:59.800215 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.800200 2565 factory.go:153] Registering CRI-O factory Jun 10 01:00:59.800289 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.800219 2565 factory.go:223] Registration of the crio container factory successfully Jun 10 01:00:59.800289 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.800245 2565 factory.go:103] Registering Raw factory Jun 10 01:00:59.800289 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.800259 2565 manager.go:1196] Started watching for new ooms in manager Jun 10 01:00:59.800680 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.800665 2565 manager.go:349] Starting recovery of all containers Jun 10 01:00:59.810145 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.810121 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:59.810315 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.810299 2565 manager.go:354] Recovery completed Jun 10 01:00:59.812440 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.812424 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-207.ec2.internal\" not found" node="ip-10-0-131-207.ec2.internal" Jun 10 01:00:59.815911 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.815897 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.817980 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.817964 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.818057 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.817995 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.818057 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.818009 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:59.818564 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.818549 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 01:00:59.818564 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.818560 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.818687 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.818562 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 01:00:59.818687 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.818632 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:00:59.819245 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.819228 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.819307 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.819258 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.819307 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.819270 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:59.820247 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.820236 2565 policy_none.go:49] "None policy: Start" Jun 10 01:00:59.820293 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.820251 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 01:00:59.820293 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.820260 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 01:00:59.821401 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.821391 2565 policy_none.go:47] "Start" Jun 10 01:00:59.849448 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.849430 2565 manager.go:337] "Starting Device Plugin manager" Jun 10 01:00:59.849579 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.849465 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 01:00:59.849579 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.849476 2565 server.go:87] "Starting device plugin registration server" Jun 10 01:00:59.849751 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.849739 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 01:00:59.849795 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.849751 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 01:00:59.849932 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.849915 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 01:00:59.850016 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.850003 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 01:00:59.850081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.850017 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 01:00:59.850600 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.850579 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 01:00:59.850684 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.850631 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:00:59.869570 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.869412 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 01:00:59.872438 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.870947 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 01:00:59.872438 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.870991 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 01:00:59.872438 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.871021 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 01:00:59.872438 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.871105 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 01:00:59.873343 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.873323 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:59.950806 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.950760 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.952239 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.952191 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.952239 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.952222 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.952239 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.952233 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:59.952405 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.952257 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-207.ec2.internal" Jun 10 01:00:59.960054 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.960037 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-207.ec2.internal" Jun 10 01:00:59.960140 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.960061 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-207.ec2.internal\": node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:00:59.971618 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.971597 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal"] Jun 10 01:00:59.971747 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.971670 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.972649 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.972634 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.972730 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.972669 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.972730 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.972683 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:59.974093 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.974078 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.974208 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.974193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:00:59.974253 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.974227 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.975165 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:00:59.975150 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:00:59.975527 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.975511 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.975593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.975525 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.975593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.975541 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.975593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.975551 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.975593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.975555 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:59.975593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.975565 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:59.976656 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.976642 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 10 01:00:59.976708 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.976667 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:59.977317 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.977304 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:59.977366 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.977333 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:59.977366 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:00:59.977344 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:00.000739 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.000714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.000838 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.000739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.000838 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.000756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c0d397031f09076e54ac96b039a5d49-config\") pod \"kube-apiserver-proxy-ip-10-0-131-207.ec2.internal\" (UID: \"3c0d397031f09076e54ac96b039a5d49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.006575 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.006559 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-207.ec2.internal\" not found" node="ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.011241 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.011219 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-207.ec2.internal\" not found" node="ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.075841 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.075814 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.101139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.101109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.101259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.101141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.101259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.101158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c0d397031f09076e54ac96b039a5d49-config\") pod \"kube-apiserver-proxy-ip-10-0-131-207.ec2.internal\" (UID: \"3c0d397031f09076e54ac96b039a5d49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.101259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.101205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c0d397031f09076e54ac96b039a5d49-config\") pod \"kube-apiserver-proxy-ip-10-0-131-207.ec2.internal\" (UID: \"3c0d397031f09076e54ac96b039a5d49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.101259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.101220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.101259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.101227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.176317 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.176274 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.277115 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.277046 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.311578 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.311555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.315641 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.315553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.378178 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.378140 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.478651 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.478618 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.579192 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.579099 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.679674 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.679642 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 10 01:01:00.687365 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.687336 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:00.699226 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.699200 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.711694 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.711665 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:01:00.713345 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.713330 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 10 01:01:00.719243 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.719224 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:01:00.724332 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.724318 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 01:01:00.724484 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.724463 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:01:00.724520 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.724482 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:01:00.724520 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.724496 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:01:00.774661 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.774632 2565 apiserver.go:52] "Watching apiserver" Jun 10 01:01:00.789463 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.789273 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 01:01:00.791265 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.791242 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wmvph","kube-system/konnectivity-agent-kfsws","kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d","openshift-cluster-node-tuning-operator/tuned-j2s9f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal","openshift-multus/multus-xp4xj","openshift-multus/network-metrics-daemon-t9m95","openshift-dns/node-resolver-54cm8","openshift-image-registry/node-ca-8ljgg","openshift-multus/multus-additional-cni-plugins-9t7lv","openshift-network-diagnostics/network-check-target-xrnmt","openshift-network-operator/iptables-alerter-t52jd","openshift-ovn-kubernetes/ovnkube-node-c42rl"] Jun 10 01:01:00.792009 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.791986 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:55:59 +0000 UTC" deadline="2028-03-18 00:06:32.337543274 +0000 UTC" Jun 10 01:01:00.792056 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.792010 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15527h5m31.545536099s" Jun 10 01:01:00.792445 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.792435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:00.792505 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.792489 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:00.794299 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.794271 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.795314 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.795290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.796422 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.796402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.796659 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.796639 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.796734 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.796719 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.796804 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.796785 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 01:01:00.797155 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.797140 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zj5pf\"" Jun 10 01:01:00.797566 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.797555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.798035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.797807 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 01:01:00.798035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.797889 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 01:01:00.798035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.797934 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.798035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.797944 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d72mg\"" Jun 10 01:01:00.798035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.798023 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.798464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.798448 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.798921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.798852 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 01:01:00.798921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.798896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 01:01:00.798921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.798900 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.799100 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.798856 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6ljkz\"" Jun 10 01:01:00.799173 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.799157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.799278 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.799252 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:00.799661 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.799641 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-llrmw\"" Jun 10 01:01:00.800038 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.800009 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.800169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.800076 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.800221 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.800192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:00.800303 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.800281 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:00.801333 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.801315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:00.802512 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.802497 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:00.803310 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.803293 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.803449 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.803433 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swcbd\"" Jun 10 01:01:00.803449 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.803441 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.803709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.803692 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.804189 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f390e74c-c25d-48c3-b820-f78faabb0f11-kubelet-config\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.804287 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-daemon-config\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804287 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-registration-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.804287 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-var-lib-kubelet\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.804440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-cni-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysconfig\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.804440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-sys\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.804440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-tuned\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.804440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e10926e2-654e-4c1a-bba8-0fedb6370c9e-host-slash\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.804440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-system-cni-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-socket-dir-parent\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-netns\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysctl-conf\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-cni-multus\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67tnd\" (UniqueName: \"kubernetes.io/projected/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-kube-api-access-67tnd\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-device-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.804703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysctl-d\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-systemd\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-lib-modules\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804819 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7fk2t\"" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xg24\" (UniqueName: \"kubernetes.io/projected/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-kube-api-access-6xg24\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e10926e2-654e-4c1a-bba8-0fedb6370c9e-iptables-alerter-script\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-cnibin\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-os-release\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-k8s-cni-cncf-io\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.804995 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-kubelet\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f390e74c-c25d-48c3-b820-f78faabb0f11-dbus\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kz4p\" (UniqueName: \"kubernetes.io/projected/e10926e2-654e-4c1a-bba8-0fedb6370c9e-kube-api-access-5kz4p\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-multus-certs\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-etc-kubernetes\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-socket-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.805169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805146 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-sys-fs\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805206 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-modprobe-d\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-host\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-cni-binary-copy\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-cni-bin\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-hostroot\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-conf-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwl8l\" (UniqueName: \"kubernetes.io/projected/75c39da5-917a-4852-a45c-ce8e1567e7f4-kube-api-access-hwl8l\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-kubernetes\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-tmp\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-run\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.805889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh4b5\" (UniqueName: \"kubernetes.io/projected/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-kube-api-access-kh4b5\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.806455 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805914 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwmtr\"" Jun 10 01:01:00.806455 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.805969 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 01:01:00.806455 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.806133 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 01:01:00.806583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.806568 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.807058 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.807040 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 01:01:00.807300 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.807287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j9p56\"" Jun 10 01:01:00.807346 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.807313 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 01:01:00.808998 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.808978 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 01:01:00.809108 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.809087 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 01:01:00.809263 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.809090 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 01:01:00.809263 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.809151 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 01:01:00.810073 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.810011 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 01:01:00.810073 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.810033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 01:01:00.810222 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.810033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m8t57\"" Jun 10 01:01:00.815061 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.815039 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:01:00.832682 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.832636 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2jf7" Jun 10 01:01:00.840642 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.840436 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2jf7" Jun 10 01:01:00.891964 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:00.891932 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0d397031f09076e54ac96b039a5d49.slice/crio-d396d67c943556aac318a565c323a8d44adacb4c6dfdc59bcadfe84bee2136c2 WatchSource:0}: Error finding container d396d67c943556aac318a565c323a8d44adacb4c6dfdc59bcadfe84bee2136c2: Status 404 returned error can't find the container with id d396d67c943556aac318a565c323a8d44adacb4c6dfdc59bcadfe84bee2136c2 Jun 10 01:01:00.896452 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.896429 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:01:00.900069 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.900051 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 01:01:00.906616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e10926e2-654e-4c1a-bba8-0fedb6370c9e-host-slash\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-system-cni-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-systemd\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-var-lib-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e10926e2-654e-4c1a-bba8-0fedb6370c9e-host-slash\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-device-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-system-cni-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.906738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906727 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-systemd\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysctl-d\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-device-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d1e069d-e288-4697-8f70-6213cef84bf5-tmp-dir\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmx2f\" (UniqueName: \"kubernetes.io/projected/2d1e069d-e288-4697-8f70-6213cef84bf5-kube-api-access-rmx2f\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-os-release\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-cni-netd\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysctl-d\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906925 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xg24\" (UniqueName: \"kubernetes.io/projected/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-kube-api-access-6xg24\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.906969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e10926e2-654e-4c1a-bba8-0fedb6370c9e-iptables-alerter-script\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-k8s-cni-cncf-io\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.907036 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-kubelet\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907098 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.907098 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:01.407077879 +0000 UTC m=+1.984429015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-kubelet\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f390e74c-c25d-48c3-b820-f78faabb0f11-dbus\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-k8s-cni-cncf-io\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-multus-certs\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-etc-kubernetes\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f390e74c-c25d-48c3-b820-f78faabb0f11-dbus\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-modprobe-d\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-multus-certs\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-etc-kubernetes\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-kubelet\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-slash\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-modprobe-d\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-ovn\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-cni-binary-copy\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-cni-bin\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-hostroot\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.907867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907434 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-conf-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-kubernetes\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-conf-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cf2845f-69bb-4f26-ae3b-fd6d3d743825-konnectivity-ca\") pod \"konnectivity-agent-kfsws\" (UID: \"8cf2845f-69bb-4f26-ae3b-fd6d3d743825\") " pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-hostroot\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-ovnkube-config\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-cni-bin\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-run\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f390e74c-c25d-48c3-b820-f78faabb0f11-kubelet-config\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-kubernetes\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-registration-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b34d5e2e-4115-4802-8f98-8914e2b01e12-host\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-env-overrides\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0175d55c-412a-4863-a379-61be7e4a967c-ovn-node-metrics-cert\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqg95\" (UniqueName: \"kubernetes.io/projected/0175d55c-412a-4863-a379-61be7e4a967c-kube-api-access-bqg95\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.908768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f390e74c-c25d-48c3-b820-f78faabb0f11-kubelet-config\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysconfig\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-cni-binary-copy\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-sys\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-registration-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.907982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysconfig\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-run\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-sys\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-socket-dir-parent\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-netns\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysctl-conf\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-socket-dir-parent\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-run-netns\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-lib-modules\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-log-socket\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-run-ovn-kubernetes\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-cni-multus\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-lib-modules\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.909554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67tnd\" (UniqueName: \"kubernetes.io/projected/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-kube-api-access-67tnd\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-sysctl-conf\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908283 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-host-var-lib-cni-multus\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vck\" (UniqueName: \"kubernetes.io/projected/b34d5e2e-4115-4802-8f98-8914e2b01e12-kube-api-access-n5vck\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-system-cni-dir\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e10926e2-654e-4c1a-bba8-0fedb6370c9e-iptables-alerter-script\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-cnibin\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-os-release\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.908467 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-socket-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.908530 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:01.408512765 +0000 UTC m=+1.985863873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-os-release\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908528 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-cnibin\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-host\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908591 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-socket-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-systemd\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.910334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-host\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kz4p\" (UniqueName: \"kubernetes.io/projected/e10926e2-654e-4c1a-bba8-0fedb6370c9e-kube-api-access-5kz4p\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-sys-fs\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-sys-fs\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-run-netns\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwl8l\" (UniqueName: \"kubernetes.io/projected/75c39da5-917a-4852-a45c-ce8e1567e7f4-kube-api-access-hwl8l\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-tmp\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-cnibin\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6d6t\" (UniqueName: \"kubernetes.io/projected/471da43b-a7c9-44db-8932-8dede3223082-kube-api-access-r6d6t\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-systemd-units\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-node-log\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.911139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.908981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4b5\" (UniqueName: \"kubernetes.io/projected/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-kube-api-access-kh4b5\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d1e069d-e288-4697-8f70-6213cef84bf5-hosts-file\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-daemon-config\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75c39da5-917a-4852-a45c-ce8e1567e7f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-var-lib-kubelet\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cf2845f-69bb-4f26-ae3b-fd6d3d743825-agent-certs\") pod \"konnectivity-agent-kfsws\" (UID: \"8cf2845f-69bb-4f26-ae3b-fd6d3d743825\") " pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909079 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909110 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-var-lib-kubelet\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-cni-bin\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-ovnkube-script-lib\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-cni-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-tuned\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b34d5e2e-4115-4802-8f98-8914e2b01e12-serviceca\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-cni-dir\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-cni-binary-copy\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-etc-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:00.911865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.909501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-multus-daemon-config\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.912627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.912519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-tmp\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.912627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.912593 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-etc-tuned\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.914826 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.914805 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:00.914981 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.914949 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:00.914981 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.914972 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:00.915119 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:00.915044 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:01.415024843 +0000 UTC m=+1.992375955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:00.916837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.916678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4b5\" (UniqueName: \"kubernetes.io/projected/68f0db7a-64fc-455a-b7bb-c53cbd7053c3-kube-api-access-kh4b5\") pod \"tuned-j2s9f\" (UID: \"68f0db7a-64fc-455a-b7bb-c53cbd7053c3\") " pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:00.917201 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.917182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67tnd\" (UniqueName: \"kubernetes.io/projected/b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c-kube-api-access-67tnd\") pod \"multus-xp4xj\" (UID: \"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c\") " pod="openshift-multus/multus-xp4xj" Jun 10 01:01:00.917305 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.917285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xg24\" (UniqueName: \"kubernetes.io/projected/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-kube-api-access-6xg24\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:00.917671 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.917657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwl8l\" (UniqueName: \"kubernetes.io/projected/75c39da5-917a-4852-a45c-ce8e1567e7f4-kube-api-access-hwl8l\") pod \"aws-ebs-csi-driver-node-jxz5d\" (UID: \"75c39da5-917a-4852-a45c-ce8e1567e7f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:00.918376 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:00.918354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kz4p\" (UniqueName: \"kubernetes.io/projected/e10926e2-654e-4c1a-bba8-0fedb6370c9e-kube-api-access-5kz4p\") pod \"iptables-alerter-t52jd\" (UID: \"e10926e2-654e-4c1a-bba8-0fedb6370c9e\") " pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:01.010015 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.009979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-log-socket\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010015 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-run-ovn-kubernetes\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010035 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vck\" (UniqueName: \"kubernetes.io/projected/b34d5e2e-4115-4802-8f98-8914e2b01e12-kube-api-access-n5vck\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-system-cni-dir\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-system-cni-dir\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010104 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-log-socket\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-run-ovn-kubernetes\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-systemd\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-systemd\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-run-netns\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-cnibin\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010367 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-run-netns\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6d6t\" (UniqueName: \"kubernetes.io/projected/471da43b-a7c9-44db-8932-8dede3223082-kube-api-access-r6d6t\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-systemd-units\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-cnibin\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-node-log\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010461 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-systemd-units\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d1e069d-e288-4697-8f70-6213cef84bf5-hosts-file\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cf2845f-69bb-4f26-ae3b-fd6d3d743825-agent-certs\") pod \"konnectivity-agent-kfsws\" (UID: \"8cf2845f-69bb-4f26-ae3b-fd6d3d743825\") " pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-node-log\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.010554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-cni-bin\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d1e069d-e288-4697-8f70-6213cef84bf5-hosts-file\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-ovnkube-script-lib\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b34d5e2e-4115-4802-8f98-8914e2b01e12-serviceca\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-cni-bin\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-cni-binary-copy\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-etc-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-var-lib-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d1e069d-e288-4697-8f70-6213cef84bf5-tmp-dir\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmx2f\" (UniqueName: \"kubernetes.io/projected/2d1e069d-e288-4697-8f70-6213cef84bf5-kube-api-access-rmx2f\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-os-release\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-cni-netd\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-kubelet\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-slash\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.011363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.010997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-ovn\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cf2845f-69bb-4f26-ae3b-fd6d3d743825-konnectivity-ca\") pod \"konnectivity-agent-kfsws\" (UID: \"8cf2845f-69bb-4f26-ae3b-fd6d3d743825\") " pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-ovnkube-config\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b34d5e2e-4115-4802-8f98-8914e2b01e12-host\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-env-overrides\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0175d55c-412a-4863-a379-61be7e4a967c-ovn-node-metrics-cert\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/471da43b-a7c9-44db-8932-8dede3223082-os-release\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqg95\" (UniqueName: \"kubernetes.io/projected/0175d55c-412a-4863-a379-61be7e4a967c-kube-api-access-bqg95\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-ovnkube-script-lib\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-run-ovn\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011242 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-kubelet\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-slash\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d1e069d-e288-4697-8f70-6213cef84bf5-tmp-dir\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-host-cni-netd\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011079 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-cni-binary-copy\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-etc-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/471da43b-a7c9-44db-8932-8dede3223082-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.012627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0175d55c-412a-4863-a379-61be7e4a967c-var-lib-openvswitch\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b34d5e2e-4115-4802-8f98-8914e2b01e12-host\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.012627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b34d5e2e-4115-4802-8f98-8914e2b01e12-serviceca\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.012627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-env-overrides\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.011970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0175d55c-412a-4863-a379-61be7e4a967c-ovnkube-config\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.012627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.012117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cf2845f-69bb-4f26-ae3b-fd6d3d743825-konnectivity-ca\") pod \"konnectivity-agent-kfsws\" (UID: \"8cf2845f-69bb-4f26-ae3b-fd6d3d743825\") " pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:01.013693 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.013666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cf2845f-69bb-4f26-ae3b-fd6d3d743825-agent-certs\") pod \"konnectivity-agent-kfsws\" (UID: \"8cf2845f-69bb-4f26-ae3b-fd6d3d743825\") " pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:01.013803 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.013774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0175d55c-412a-4863-a379-61be7e4a967c-ovn-node-metrics-cert\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.020270 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.020243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmx2f\" (UniqueName: \"kubernetes.io/projected/2d1e069d-e288-4697-8f70-6213cef84bf5-kube-api-access-rmx2f\") pod \"node-resolver-54cm8\" (UID: \"2d1e069d-e288-4697-8f70-6213cef84bf5\") " pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.020270 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.020255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqg95\" (UniqueName: \"kubernetes.io/projected/0175d55c-412a-4863-a379-61be7e4a967c-kube-api-access-bqg95\") pod \"ovnkube-node-c42rl\" (UID: \"0175d55c-412a-4863-a379-61be7e4a967c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.020820 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.020801 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vck\" (UniqueName: \"kubernetes.io/projected/b34d5e2e-4115-4802-8f98-8914e2b01e12-kube-api-access-n5vck\") pod \"node-ca-8ljgg\" (UID: \"b34d5e2e-4115-4802-8f98-8914e2b01e12\") " pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.020964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.020829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6d6t\" (UniqueName: \"kubernetes.io/projected/471da43b-a7c9-44db-8932-8dede3223082-kube-api-access-r6d6t\") pod \"multus-additional-cni-plugins-9t7lv\" (UID: \"471da43b-a7c9-44db-8932-8dede3223082\") " pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.032229 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.032204 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ee8c279971671d1a011e53453b54ab.slice/crio-5ebc1e107ad2c170dcd1269ce92f61720d519578bccf3c7610a755e308af9b27 WatchSource:0}: Error finding container 5ebc1e107ad2c170dcd1269ce92f61720d519578bccf3c7610a755e308af9b27: Status 404 returned error can't find the container with id 5ebc1e107ad2c170dcd1269ce92f61720d519578bccf3c7610a755e308af9b27 Jun 10 01:01:01.116769 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.116687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t52jd" Jun 10 01:01:01.124478 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.124452 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10926e2_654e_4c1a_bba8_0fedb6370c9e.slice/crio-f7e31223a6d8d85cd6bdd504e02c5688f7e2b54692f91cd9c71424a1717034c8 WatchSource:0}: Error finding container f7e31223a6d8d85cd6bdd504e02c5688f7e2b54692f91cd9c71424a1717034c8: Status 404 returned error can't find the container with id f7e31223a6d8d85cd6bdd504e02c5688f7e2b54692f91cd9c71424a1717034c8 Jun 10 01:01:01.129612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.129595 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xp4xj" Jun 10 01:01:01.137046 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.137025 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146bf69_8c8d_43b0_b2d5_cd0d73b78b6c.slice/crio-069a055adbf6c6938972a67659a7ae6d09f896874104bf869609e37863deea75 WatchSource:0}: Error finding container 069a055adbf6c6938972a67659a7ae6d09f896874104bf869609e37863deea75: Status 404 returned error can't find the container with id 069a055adbf6c6938972a67659a7ae6d09f896874104bf869609e37863deea75 Jun 10 01:01:01.147213 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.147194 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" Jun 10 01:01:01.154277 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.154246 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c39da5_917a_4852_a45c_ce8e1567e7f4.slice/crio-80e744d083900509dfb2326f16968c35a2187b5bb8528867fe1fca034cb1d5a6 WatchSource:0}: Error finding container 80e744d083900509dfb2326f16968c35a2187b5bb8528867fe1fca034cb1d5a6: Status 404 returned error can't find the container with id 80e744d083900509dfb2326f16968c35a2187b5bb8528867fe1fca034cb1d5a6 Jun 10 01:01:01.159314 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.159292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" Jun 10 01:01:01.166113 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.166093 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f0db7a_64fc_455a_b7bb_c53cbd7053c3.slice/crio-950af3ce92e6f327aae9fbc579919594a781911b4162b51d1496fb48a4a5c131 WatchSource:0}: Error finding container 950af3ce92e6f327aae9fbc579919594a781911b4162b51d1496fb48a4a5c131: Status 404 returned error can't find the container with id 950af3ce92e6f327aae9fbc579919594a781911b4162b51d1496fb48a4a5c131 Jun 10 01:01:01.177673 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.177651 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-54cm8" Jun 10 01:01:01.184659 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.184629 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1e069d_e288_4697_8f70_6213cef84bf5.slice/crio-2add09595314742b8ff25910b40d2cf3d3432f6da672a1045a1d15e962d901c7 WatchSource:0}: Error finding container 2add09595314742b8ff25910b40d2cf3d3432f6da672a1045a1d15e962d901c7: Status 404 returned error can't find the container with id 2add09595314742b8ff25910b40d2cf3d3432f6da672a1045a1d15e962d901c7 Jun 10 01:01:01.193526 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.193510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ljgg" Jun 10 01:01:01.199314 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.199292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" Jun 10 01:01:01.201009 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.200906 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34d5e2e_4115_4802_8f98_8914e2b01e12.slice/crio-a9eb6dc3fb55f672696d79bbeff3f4f9f84f9c7f1281055bf3679cdfe8d7aab1 WatchSource:0}: Error finding container a9eb6dc3fb55f672696d79bbeff3f4f9f84f9c7f1281055bf3679cdfe8d7aab1: Status 404 returned error can't find the container with id a9eb6dc3fb55f672696d79bbeff3f4f9f84f9c7f1281055bf3679cdfe8d7aab1 Jun 10 01:01:01.204629 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.204611 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:01.206490 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.206463 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471da43b_a7c9_44db_8932_8dede3223082.slice/crio-5edab9fc494abd2beb3953a5cd1978b142eb044833f198aaedc74d5d469da08e WatchSource:0}: Error finding container 5edab9fc494abd2beb3953a5cd1978b142eb044833f198aaedc74d5d469da08e: Status 404 returned error can't find the container with id 5edab9fc494abd2beb3953a5cd1978b142eb044833f198aaedc74d5d469da08e Jun 10 01:01:01.210701 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.210682 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:01.212450 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.212429 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf2845f_69bb_4f26_ae3b_fd6d3d743825.slice/crio-d3009279a8d17283f20106cb82aee77950038be5bb848f1ea4a350abb510828e WatchSource:0}: Error finding container d3009279a8d17283f20106cb82aee77950038be5bb848f1ea4a350abb510828e: Status 404 returned error can't find the container with id d3009279a8d17283f20106cb82aee77950038be5bb848f1ea4a350abb510828e Jun 10 01:01:01.218476 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:01.218456 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0175d55c_412a_4863_a379_61be7e4a967c.slice/crio-b3944b92d4edbfc2f23a3c381c5c9f7f36dbf5a46fbb02b37f319f5aaf7e0159 WatchSource:0}: Error finding container b3944b92d4edbfc2f23a3c381c5c9f7f36dbf5a46fbb02b37f319f5aaf7e0159: Status 404 returned error can't find the container with id b3944b92d4edbfc2f23a3c381c5c9f7f36dbf5a46fbb02b37f319f5aaf7e0159 Jun 10 01:01:01.247068 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.247037 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:01.413804 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.413711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:01.413804 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.413766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:01.414012 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.413854 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:01.414012 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.413862 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:01.414012 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.413928 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:02.413913498 +0000 UTC m=+2.991264601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:01.414012 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.413941 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:02.413935489 +0000 UTC m=+2.991286591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:01.515183 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.515139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:01.515377 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.515354 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:01.515466 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.515384 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:01.515466 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.515398 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:01.515466 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.515463 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:02.515443208 +0000 UTC m=+3.092794315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:01.654372 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.654152 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:01.808669 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.808470 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:01.842517 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.842449 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:56:00 +0000 UTC" deadline="2027-12-04 02:37:29.285499849 +0000 UTC" Jun 10 01:01:01.842517 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.842516 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13009h36m27.442989155s" Jun 10 01:01:01.882433 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.882403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:01.882606 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:01.882524 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:01.897639 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.897578 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xp4xj" event={"ID":"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c","Type":"ContainerStarted","Data":"069a055adbf6c6938972a67659a7ae6d09f896874104bf869609e37863deea75"} Jun 10 01:01:01.924423 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.924323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" event={"ID":"78ee8c279971671d1a011e53453b54ab","Type":"ContainerStarted","Data":"5ebc1e107ad2c170dcd1269ce92f61720d519578bccf3c7610a755e308af9b27"} Jun 10 01:01:01.929463 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.929361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerStarted","Data":"5edab9fc494abd2beb3953a5cd1978b142eb044833f198aaedc74d5d469da08e"} Jun 10 01:01:01.938808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.938769 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-54cm8" event={"ID":"2d1e069d-e288-4697-8f70-6213cef84bf5","Type":"ContainerStarted","Data":"2add09595314742b8ff25910b40d2cf3d3432f6da672a1045a1d15e962d901c7"} Jun 10 01:01:01.943557 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.943523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t52jd" event={"ID":"e10926e2-654e-4c1a-bba8-0fedb6370c9e","Type":"ContainerStarted","Data":"f7e31223a6d8d85cd6bdd504e02c5688f7e2b54692f91cd9c71424a1717034c8"} Jun 10 01:01:01.964163 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.964125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" event={"ID":"3c0d397031f09076e54ac96b039a5d49","Type":"ContainerStarted","Data":"d396d67c943556aac318a565c323a8d44adacb4c6dfdc59bcadfe84bee2136c2"} Jun 10 01:01:01.966760 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.966728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"b3944b92d4edbfc2f23a3c381c5c9f7f36dbf5a46fbb02b37f319f5aaf7e0159"} Jun 10 01:01:01.982136 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:01.982096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfsws" event={"ID":"8cf2845f-69bb-4f26-ae3b-fd6d3d743825","Type":"ContainerStarted","Data":"d3009279a8d17283f20106cb82aee77950038be5bb848f1ea4a350abb510828e"} Jun 10 01:01:02.007364 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.007266 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ljgg" event={"ID":"b34d5e2e-4115-4802-8f98-8914e2b01e12","Type":"ContainerStarted","Data":"a9eb6dc3fb55f672696d79bbeff3f4f9f84f9c7f1281055bf3679cdfe8d7aab1"} Jun 10 01:01:02.023046 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.023007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" event={"ID":"68f0db7a-64fc-455a-b7bb-c53cbd7053c3","Type":"ContainerStarted","Data":"950af3ce92e6f327aae9fbc579919594a781911b4162b51d1496fb48a4a5c131"} Jun 10 01:01:02.041968 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.041929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" event={"ID":"75c39da5-917a-4852-a45c-ce8e1567e7f4","Type":"ContainerStarted","Data":"80e744d083900509dfb2326f16968c35a2187b5bb8528867fe1fca034cb1d5a6"} Jun 10 01:01:02.423165 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.423066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:02.423165 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.423145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:02.423374 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.423286 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:02.423374 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.423346 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:04.423327354 +0000 UTC m=+5.000678462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:02.423842 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.423821 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:02.423956 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.423896 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:04.423865335 +0000 UTC m=+5.001216452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:02.524426 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.524387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:02.524669 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.524648 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:02.524737 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.524680 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:02.524737 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.524694 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:02.524841 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.524757 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:04.524734752 +0000 UTC m=+5.102085896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:02.578621 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.578119 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:02.843600 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.843537 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:56:00 +0000 UTC" deadline="2027-11-15 22:14:38.554834129 +0000 UTC" Jun 10 01:01:02.843600 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.843597 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12573h13m35.711241518s" Jun 10 01:01:02.872277 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.872247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:02.872481 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.872425 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:02.872568 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:02.872508 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:02.872617 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:02.872584 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:03.874805 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:03.871946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:03.874805 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:03.872074 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:04.439782 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:04.439747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:04.439986 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:04.439817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:04.440043 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.439990 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:04.440095 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.440054 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:08.440035441 +0000 UTC m=+9.017386547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:04.440290 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.440250 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:04.440377 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.440318 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:08.440300835 +0000 UTC m=+9.017651952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:04.542258 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:04.542210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:04.542481 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.542387 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:04.542481 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.542407 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:04.542481 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.542420 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:04.542621 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.542489 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:08.542470342 +0000 UTC m=+9.119821459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:04.872259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:04.872222 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:04.872448 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.872378 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:04.872751 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:04.872734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:04.872814 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:04.872805 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:05.871890 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:05.871839 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:05.872380 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:05.871984 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:06.872104 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:06.872058 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:06.872576 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:06.872173 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:06.872576 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:06.872534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:06.872707 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:06.872597 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:07.871675 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:07.871645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:07.871864 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:07.871764 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:08.480086 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:08.480043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:08.480559 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:08.480106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:08.480559 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.480207 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:08.480559 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.480212 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:08.480559 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.480268 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:16.480251053 +0000 UTC m=+17.057602172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:08.480559 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.480287 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:16.480277876 +0000 UTC m=+17.057628981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:08.581233 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:08.581189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:08.581411 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.581361 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:08.581411 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.581383 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:08.581411 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.581396 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:08.581590 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.581456 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:16.581437392 +0000 UTC m=+17.158788512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:08.871829 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:08.871746 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:08.871829 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:08.871788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:08.872165 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.871921 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:08.872165 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:08.872059 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:09.874390 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:09.874357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:09.874820 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:09.874464 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:10.871452 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:10.871413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:10.871620 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:10.871426 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:10.871620 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:10.871545 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:10.871744 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:10.871637 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:11.872341 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:11.872301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:11.872791 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:11.872439 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:12.872197 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:12.872154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:12.872395 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:12.872294 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:12.872395 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:12.872337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:12.872768 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:12.872425 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:13.874362 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:13.874331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:13.874770 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:13.874454 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:14.871219 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:14.871183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:14.871399 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:14.871246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:14.871399 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:14.871325 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:14.871502 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:14.871450 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:15.872366 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:15.872331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:15.872820 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:15.872470 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:16.535860 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:16.535824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:16.536092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:16.535890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:16.536092 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.536004 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:16.536092 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.536083 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:32.536062261 +0000 UTC m=+33.113413381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:16.536306 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.536004 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:16.536306 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.536151 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:32.536132753 +0000 UTC m=+33.113483925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:16.636776 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:16.636741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:16.636963 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.636946 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:16.637010 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.636972 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:16.637010 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.636982 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:16.637100 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.637042 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:32.637020784 +0000 UTC m=+33.214371889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:16.872098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:16.872063 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:16.872269 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:16.872064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:16.872269 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.872210 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:16.872348 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:16.872286 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:17.871701 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:17.871660 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:17.872214 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:17.871802 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:18.871518 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:18.871482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:18.871701 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:18.871609 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:18.871701 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:18.871643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:18.871701 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:18.871695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:19.872206 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:19.872171 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:19.872617 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:19.872344 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:20.871664 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:20.871634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:20.871664 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:20.871649 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:20.871860 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:20.871736 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:20.871938 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:20.871905 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:21.871764 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:21.871546 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:21.872591 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:21.871902 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:22.089671 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.089484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"529407521c7e79fb4c72a666012a674f1067812756ae2ae7b62547c4af26cb31"} Jun 10 01:01:22.089809 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.089749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"1f9c7153a43ff0005ae9278ffca1ba4da81c4e15213d673cd436f10944b6b75c"} Jun 10 01:01:22.089809 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.089801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"af3b817080989bcce8ab2ad0a0401b2367b3d0fc217c9dfbb4b41086d36f4787"} Jun 10 01:01:22.090799 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.090767 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfsws" event={"ID":"8cf2845f-69bb-4f26-ae3b-fd6d3d743825","Type":"ContainerStarted","Data":"f1885686f8ca93d39cedec206ce5f0b659df18cf072711a5a836140fc7c9f2b7"} Jun 10 01:01:22.092097 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.092073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ljgg" event={"ID":"b34d5e2e-4115-4802-8f98-8914e2b01e12","Type":"ContainerStarted","Data":"12458c648e346fee7231e792632697b6909737126c9f71000aea1b8c86c22e0a"} Jun 10 01:01:22.093441 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.093422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" event={"ID":"68f0db7a-64fc-455a-b7bb-c53cbd7053c3","Type":"ContainerStarted","Data":"2c290e755d02d91b027cc9b1675a628461d1a6bebe5d39da9da90e43eda125c8"} Jun 10 01:01:22.094914 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.094893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" event={"ID":"75c39da5-917a-4852-a45c-ce8e1567e7f4","Type":"ContainerStarted","Data":"1171e882b5285788d792cb3644743818a323eb68f1e76bb2a20a8d733611a9de"} Jun 10 01:01:22.096244 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.096214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xp4xj" event={"ID":"b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c","Type":"ContainerStarted","Data":"bdf6b903af5f87e631fd1517e64578bddbc87a2bb638aae44f2b1a6c6f9fc384"} Jun 10 01:01:22.097523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.097504 2565 generic.go:356] "Generic (PLEG): container finished" podID="78ee8c279971671d1a011e53453b54ab" containerID="61ba75a8a6f49c7e9ee18cf9338b2245df607be667ada3a1f7b0a9875c4a2772" exitCode=0 Jun 10 01:01:22.097601 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.097573 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" event={"ID":"78ee8c279971671d1a011e53453b54ab","Type":"ContainerDied","Data":"61ba75a8a6f49c7e9ee18cf9338b2245df607be667ada3a1f7b0a9875c4a2772"} Jun 10 01:01:22.099063 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.099041 2565 generic.go:356] "Generic (PLEG): container finished" podID="471da43b-a7c9-44db-8932-8dede3223082" containerID="27fbf41c9f97f35672d85410c688fe521bc8280baf942d4fe5deeedd83513e16" exitCode=0 Jun 10 01:01:22.099154 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.099132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerDied","Data":"27fbf41c9f97f35672d85410c688fe521bc8280baf942d4fe5deeedd83513e16"} Jun 10 01:01:22.100591 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.100509 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-54cm8" event={"ID":"2d1e069d-e288-4697-8f70-6213cef84bf5","Type":"ContainerStarted","Data":"4782f22fd2f33728ff0e1343a7be34cc750c11cedec3df9e08d078b85e312744"} Jun 10 01:01:22.101887 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.101851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" event={"ID":"3c0d397031f09076e54ac96b039a5d49","Type":"ContainerStarted","Data":"8bdfad19ba589c0121c446e675f50c53500143fb0e9217226084ab25d7bfc1c0"} Jun 10 01:01:22.104863 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.104825 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kfsws" podStartSLOduration=1.80486268 podStartE2EDuration="22.104814429s" totalImagesPullingTime="20.299951749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:22.10461967 +0000 UTC m=+22.681970794" watchObservedRunningTime="2026-06-10 01:01:22.104814429 +0000 UTC m=+22.682165554" Jun 10 01:01:22.117605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.117566 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-54cm8" podStartSLOduration=1.786898598 podStartE2EDuration="22.117552388s" totalImagesPullingTime="20.33065379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:22.117226295 +0000 UTC m=+22.694577432" watchObservedRunningTime="2026-06-10 01:01:22.117552388 +0000 UTC m=+22.694903512" Jun 10 01:01:22.130606 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.130563 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8ljgg" podStartSLOduration=1.819872186 podStartE2EDuration="22.130551158s" totalImagesPullingTime="20.310678972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:22.13040527 +0000 UTC m=+22.707756395" watchObservedRunningTime="2026-06-10 01:01:22.130551158 +0000 UTC m=+22.707902283" Jun 10 01:01:22.145378 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.145344 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xp4xj" podStartSLOduration=1.768370191 podStartE2EDuration="22.145330786s" totalImagesPullingTime="20.376960595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:22.14522023 +0000 UTC m=+22.722571359" watchObservedRunningTime="2026-06-10 01:01:22.145330786 +0000 UTC m=+22.722681891" Jun 10 01:01:22.192330 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.192285 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" podStartSLOduration=22.192266543 podStartE2EDuration="22.192266543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:22.192227144 +0000 UTC m=+22.769578269" watchObservedRunningTime="2026-06-10 01:01:22.192266543 +0000 UTC m=+22.769617668" Jun 10 01:01:22.209523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.209484 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j2s9f" podStartSLOduration=1.91786214 podStartE2EDuration="22.209470338s" totalImagesPullingTime="20.291608198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:22.209082697 +0000 UTC m=+22.786433823" watchObservedRunningTime="2026-06-10 01:01:22.209470338 +0000 UTC m=+22.786821463" Jun 10 01:01:22.217699 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.217679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:22.292834 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.292796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:22.343126 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.343083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:22.711818 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.711796 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:22.712359 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.712339 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:22.871446 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.871380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:22.871590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:22.871380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:22.871590 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:22.871476 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:22.871590 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:22.871566 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:23.105120 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.105082 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t52jd" event={"ID":"e10926e2-654e-4c1a-bba8-0fedb6370c9e","Type":"ContainerStarted","Data":"eb6d5fec04770873673909eec2c445c7095bcdefafa1c6603eb57bf04c5513d6"} Jun 10 01:01:23.108010 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.107983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"08060e05749c98e974bbac72668735914112448afdbca9033f86f5b44565239c"} Jun 10 01:01:23.108135 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.108070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"194ecf39a1aa8f1bb39f505cd014a2a4efbfeba155615481072145724c2f0685"} Jun 10 01:01:23.108135 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.108126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"c4af1f5d8f0a8c7929916d95668713578bfb6a537ba0ada1144726e189227099"} Jun 10 01:01:23.109661 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.109625 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" event={"ID":"78ee8c279971671d1a011e53453b54ab","Type":"ContainerStarted","Data":"f40501aa51daf6a5c95edc854a0930ceb137a942d1349a11381efdd72ec3a983"} Jun 10 01:01:23.118808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.118769 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t52jd" podStartSLOduration=3.785471639 podStartE2EDuration="24.118755613s" totalImagesPullingTime="20.333283974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:23.118459864 +0000 UTC m=+23.695810988" watchObservedRunningTime="2026-06-10 01:01:23.118755613 +0000 UTC m=+23.696106738" Jun 10 01:01:23.131503 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.131433 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" podStartSLOduration=23.131419865 podStartE2EDuration="23.131419865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:23.131189138 +0000 UTC m=+23.708540263" watchObservedRunningTime="2026-06-10 01:01:23.131419865 +0000 UTC m=+23.708770990" Jun 10 01:01:23.236207 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.236171 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:23.286012 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.285964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:23.872046 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:23.872005 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:23.872314 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:23.872109 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:24.075371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.075348 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 01:01:24.113093 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.113060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" event={"ID":"75c39da5-917a-4852-a45c-ce8e1567e7f4","Type":"ContainerStarted","Data":"609f9307373789a34904296a8b461fdcf2f7ab3025f45e0f364e31b82b1cb63e"} Jun 10 01:01:24.113501 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.113264 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 01:01:24.870948 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.870831 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T01:01:24.075364787Z","UUID":"ffb9bcab-9e36-4c39-9bf3-91709d7a648c","Handler":null,"Name":"","Endpoint":""} Jun 10 01:01:24.871230 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.871211 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:24.871310 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.871218 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:24.871359 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:24.871310 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:24.871430 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:24.871402 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:24.872800 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.872782 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 01:01:24.872944 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:24.872819 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 01:01:25.117600 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:25.117560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" event={"ID":"75c39da5-917a-4852-a45c-ce8e1567e7f4","Type":"ContainerStarted","Data":"9064829fd51fcec84df1e22aa0db56befac479ade1cdbd2690caa1fd46dcd8a1"} Jun 10 01:01:25.120629 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:25.120606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"44dd8d03a81b3d3c77d0c5411870077e147a45c2d4eadd5780f46165b5cfa8ae"} Jun 10 01:01:25.134045 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:25.133970 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxz5d" podStartSLOduration=1.90397715 podStartE2EDuration="25.133956597s" totalImagesPullingTime="23.229979447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:25.133343945 +0000 UTC m=+25.710695091" watchObservedRunningTime="2026-06-10 01:01:25.133956597 +0000 UTC m=+25.711307721" Jun 10 01:01:25.872107 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:25.872075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:25.872269 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:25.872202 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:26.871335 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:26.871249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:26.871807 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:26.871249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:26.871807 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:26.871407 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:26.871807 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:26.871524 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:27.129419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:27.129338 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" event={"ID":"0175d55c-412a-4863-a379-61be7e4a967c","Type":"ContainerStarted","Data":"faf484d828bb9d5d68d3bd258a6eb5c2f68f1add719084650b6a67b9198540e3"} Jun 10 01:01:27.129728 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:27.129708 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:27.130248 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:27.129794 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:27.148193 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:27.148166 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:27.154176 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:27.154133 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" podStartSLOduration=6.704165208 podStartE2EDuration="27.154114309s" totalImagesPullingTime="20.449949101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:27.15385651 +0000 UTC m=+27.731207673" watchObservedRunningTime="2026-06-10 01:01:27.154114309 +0000 UTC m=+27.731465434" Jun 10 01:01:27.871707 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:27.871512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:27.872160 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:27.871815 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:28.132321 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.132233 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:28.147281 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.147257 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:01:28.719973 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.719939 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xrnmt"] Jun 10 01:01:28.720137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.720039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:28.720188 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:28.720156 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:28.724013 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.723982 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wmvph"] Jun 10 01:01:28.724200 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.724102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:28.724256 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:28.724206 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:28.724675 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.724649 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t9m95"] Jun 10 01:01:28.724792 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:28.724750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:28.724893 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:28.724851 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:29.872094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:29.872065 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:29.872745 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:29.872150 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:30.142865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:30.142790 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:30.143040 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:30.142932 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 01:01:30.143591 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:30.143576 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfsws" Jun 10 01:01:30.200694 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:30.200378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:30.872139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:30.872100 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:30.872139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:30.872144 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:30.872566 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:30.872212 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:30.872566 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:30.872319 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:31.139016 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:31.138833 2565 generic.go:356] "Generic (PLEG): container finished" podID="471da43b-a7c9-44db-8932-8dede3223082" containerID="2bcda7081db90b5a738d6e6fa7b4692c72ca0f975adfe6f89edb475c3ccce53f" exitCode=0 Jun 10 01:01:31.139184 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:31.138899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerDied","Data":"2bcda7081db90b5a738d6e6fa7b4692c72ca0f975adfe6f89edb475c3ccce53f"} Jun 10 01:01:31.872244 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:31.872210 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:31.872690 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:31.872356 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:32.557462 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:32.557431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:32.557648 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:32.557474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:32.557648 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.557572 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:32.557648 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.557573 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:32.557648 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.557623 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:04.557610208 +0000 UTC m=+65.134961311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:32.557648 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.557637 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret podName:f390e74c-c25d-48c3-b820-f78faabb0f11 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:04.557631172 +0000 UTC m=+65.134982275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret") pod "global-pull-secret-syncer-wmvph" (UID: "f390e74c-c25d-48c3-b820-f78faabb0f11") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:32.658349 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:32.658322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:32.658549 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.658527 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:32.658611 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.658562 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:32.658611 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.658579 2565 projected.go:196] Error preparing data for projected volume kube-api-access-n8vb8 for pod openshift-network-diagnostics/network-check-target-xrnmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:32.658673 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.658652 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8 podName:0f45ef65-20f3-4cd3-aab9-8117c4d49646 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:04.65863186 +0000 UTC m=+65.235983048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8vb8" (UniqueName: "kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8") pod "network-check-target-xrnmt" (UID: "0f45ef65-20f3-4cd3-aab9-8117c4d49646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:32.871705 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:32.871626 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:32.871705 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:32.871665 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:32.871948 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.871735 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrnmt" podUID="0f45ef65-20f3-4cd3-aab9-8117c4d49646" Jun 10 01:01:32.871948 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:32.871899 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:01:33.144139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:33.144051 2565 generic.go:356] "Generic (PLEG): container finished" podID="471da43b-a7c9-44db-8932-8dede3223082" containerID="78095de559b6b125d62b3bd087bccb66f6355f608ad62ef8c69289f2e8bcf8be" exitCode=0 Jun 10 01:01:33.144139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:33.144107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerDied","Data":"78095de559b6b125d62b3bd087bccb66f6355f608ad62ef8c69289f2e8bcf8be"} Jun 10 01:01:33.871632 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:33.871606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:33.871756 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:33.871736 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmvph" podUID="f390e74c-c25d-48c3-b820-f78faabb0f11" Jun 10 01:01:34.148807 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.148775 2565 generic.go:356] "Generic (PLEG): container finished" podID="471da43b-a7c9-44db-8932-8dede3223082" containerID="94473b4db04b32bd6163fa7bba90885c53a247d71a780b0a6059a0d01c765391" exitCode=0 Jun 10 01:01:34.149192 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.148839 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerDied","Data":"94473b4db04b32bd6163fa7bba90885c53a247d71a780b0a6059a0d01c765391"} Jun 10 01:01:34.289132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.289103 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeReady" Jun 10 01:01:34.289323 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.289248 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 01:01:34.340899 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.340840 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hfddt"] Jun 10 01:01:34.342894 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.342852 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.345306 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.345286 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 01:01:34.345306 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.345304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 01:01:34.345470 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.345314 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vqpqf\"" Jun 10 01:01:34.346477 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.346440 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2hh2q"] Jun 10 01:01:34.348059 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.348042 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.350399 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.350299 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 01:01:34.350399 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.350327 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 01:01:34.350521 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.350304 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvqtt\"" Jun 10 01:01:34.350578 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.350559 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 01:01:34.356316 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.356293 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfddt"] Jun 10 01:01:34.367921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.367852 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2hh2q"] Jun 10 01:01:34.449551 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.449516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:34.473538 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.473505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bb82\" (UniqueName: \"kubernetes.io/projected/7f152419-a11c-4256-9ecc-778174e1b31c-kube-api-access-8bb82\") pod \"ingress-canary-2hh2q\" (UID: \"7f152419-a11c-4256-9ecc-778174e1b31c\") " pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.473674 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.473543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.473674 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.473635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2caca382-1d26-40ad-91ec-515564f2319c-tmp-dir\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.473674 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.473664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2caca382-1d26-40ad-91ec-515564f2319c-config-volume\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.473801 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.473686 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f152419-a11c-4256-9ecc-778174e1b31c-cert\") pod \"ingress-canary-2hh2q\" (UID: \"7f152419-a11c-4256-9ecc-778174e1b31c\") " pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.473801 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.473703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhhsm\" (UniqueName: \"kubernetes.io/projected/2caca382-1d26-40ad-91ec-515564f2319c-kube-api-access-lhhsm\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.501542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.501508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:34.574408 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2caca382-1d26-40ad-91ec-515564f2319c-tmp-dir\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.574408 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574407 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2caca382-1d26-40ad-91ec-515564f2319c-config-volume\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.574646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f152419-a11c-4256-9ecc-778174e1b31c-cert\") pod \"ingress-canary-2hh2q\" (UID: \"7f152419-a11c-4256-9ecc-778174e1b31c\") " pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.574646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhhsm\" (UniqueName: \"kubernetes.io/projected/2caca382-1d26-40ad-91ec-515564f2319c-kube-api-access-lhhsm\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.574646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bb82\" (UniqueName: \"kubernetes.io/projected/7f152419-a11c-4256-9ecc-778174e1b31c-kube-api-access-8bb82\") pod \"ingress-canary-2hh2q\" (UID: \"7f152419-a11c-4256-9ecc-778174e1b31c\") " pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.574646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.574646 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:34.574601 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:34.574871 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:34.574656 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:01:35.074638986 +0000 UTC m=+35.651990089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:01:34.574871 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.574786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2caca382-1d26-40ad-91ec-515564f2319c-tmp-dir\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.575073 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.575052 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2caca382-1d26-40ad-91ec-515564f2319c-config-volume\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.578979 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.578955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f152419-a11c-4256-9ecc-778174e1b31c-cert\") pod \"ingress-canary-2hh2q\" (UID: \"7f152419-a11c-4256-9ecc-778174e1b31c\") " pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.583289 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.583263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhhsm\" (UniqueName: \"kubernetes.io/projected/2caca382-1d26-40ad-91ec-515564f2319c-kube-api-access-lhhsm\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:34.583809 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.583793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bb82\" (UniqueName: \"kubernetes.io/projected/7f152419-a11c-4256-9ecc-778174e1b31c-kube-api-access-8bb82\") pod \"ingress-canary-2hh2q\" (UID: \"7f152419-a11c-4256-9ecc-778174e1b31c\") " pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.658043 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.657963 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2hh2q" Jun 10 01:01:34.804046 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.803870 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2hh2q"] Jun 10 01:01:34.808071 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:01:34.808047 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f152419_a11c_4256_9ecc_778174e1b31c.slice/crio-d412cb8f907bf9a794ab284a15cfd3d9c34b55aa24b3f895a6f4b49846bae336 WatchSource:0}: Error finding container d412cb8f907bf9a794ab284a15cfd3d9c34b55aa24b3f895a6f4b49846bae336: Status 404 returned error can't find the container with id d412cb8f907bf9a794ab284a15cfd3d9c34b55aa24b3f895a6f4b49846bae336 Jun 10 01:01:34.871913 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.871886 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:01:34.872081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.871886 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:01:34.874668 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.874640 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:01:34.874899 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.874826 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qp5n8\"" Jun 10 01:01:34.874899 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.874833 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zlvbp\"" Jun 10 01:01:34.875760 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.875736 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:01:34.875916 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:34.875737 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:01:35.079332 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:35.079298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:35.079530 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:35.079432 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:35.079530 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:35.079499 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:01:36.079482341 +0000 UTC m=+36.656833446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:01:35.153052 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:35.153010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2hh2q" event={"ID":"7f152419-a11c-4256-9ecc-778174e1b31c","Type":"ContainerStarted","Data":"d412cb8f907bf9a794ab284a15cfd3d9c34b55aa24b3f895a6f4b49846bae336"} Jun 10 01:01:35.872061 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:35.872024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:01:35.875013 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:35.874990 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:01:36.086769 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:36.086730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:36.086965 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:36.086918 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:36.087046 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:36.086989 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:01:38.086969677 +0000 UTC m=+38.664320802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:01:38.102513 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:38.102416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:38.103125 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:38.102541 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:38.103125 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:38.102608 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:01:42.10259032 +0000 UTC m=+42.679941439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:01:38.982249 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:38.982214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:39.037269 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:39.037224 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:40.167733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:40.167694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2hh2q" event={"ID":"7f152419-a11c-4256-9ecc-778174e1b31c","Type":"ContainerStarted","Data":"a840af1cf12d50426e924ab95798ed5a4dc4da356276d8a74b6a7eac2fff4968"} Jun 10 01:01:40.170394 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:40.170365 2565 generic.go:356] "Generic (PLEG): container finished" podID="471da43b-a7c9-44db-8932-8dede3223082" containerID="8d02a59aa943725cf71817cbebe321dedc88bc48f2ff56ba66a521007017c04f" exitCode=0 Jun 10 01:01:40.170493 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:40.170412 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerDied","Data":"8d02a59aa943725cf71817cbebe321dedc88bc48f2ff56ba66a521007017c04f"} Jun 10 01:01:40.183178 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:40.183128 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2hh2q" podStartSLOduration=1.693801144 podStartE2EDuration="6.18311431s" totalImagesPullingTime="4.489313166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:40.182468756 +0000 UTC m=+40.759819900" watchObservedRunningTime="2026-06-10 01:01:40.18311431 +0000 UTC m=+40.760465434" Jun 10 01:01:41.176009 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:41.175964 2565 generic.go:356] "Generic (PLEG): container finished" podID="471da43b-a7c9-44db-8932-8dede3223082" containerID="6089d65452a080e4b2ad19fab9c6629e08861d6bd0565bd834726f63dd2d8e85" exitCode=0 Jun 10 01:01:41.176458 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:41.176056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerDied","Data":"6089d65452a080e4b2ad19fab9c6629e08861d6bd0565bd834726f63dd2d8e85"} Jun 10 01:01:42.134904 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:42.134824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:42.135069 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:42.134998 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:42.135069 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:42.135065 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:01:50.135048206 +0000 UTC m=+50.712399311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:01:42.182718 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:42.182670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" event={"ID":"471da43b-a7c9-44db-8932-8dede3223082","Type":"ContainerStarted","Data":"eb6a1e6b5e9e3ea4e545f09147d9b730f47077470eedc5fde541c091835b3e75"} Jun 10 01:01:42.206894 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:42.206836 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9t7lv" podStartSLOduration=6.951311963 podStartE2EDuration="42.206821629s" totalImagesPullingTime="35.255509666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:42.205291579 +0000 UTC m=+42.782642704" watchObservedRunningTime="2026-06-10 01:01:42.206821629 +0000 UTC m=+42.784172754" Jun 10 01:01:42.352807 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:42.352766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:42.424702 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:42.424608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:50.192740 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:01:50.192693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:01:50.193294 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:50.192808 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:50.193294 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:01:50.192870 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:06.192855198 +0000 UTC m=+66.770206301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:02:00.146058 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:00.146030 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c42rl" Jun 10 01:02:00.278307 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:00.278271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:00.381795 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:00.381766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:00.432636 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:00.432551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:02:04.590133 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.590080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:02:04.590133 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.590150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:02:04.592654 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.592632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:02:04.592772 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.592632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:02:04.600776 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:02:04.600751 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:02:04.600835 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:02:04.600825 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:08.600808239 +0000 UTC m=+129.178159346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : secret "metrics-daemon-secret" not found Jun 10 01:02:04.603797 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.603765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f390e74c-c25d-48c3-b820-f78faabb0f11-original-pull-secret\") pod \"global-pull-secret-syncer-wmvph\" (UID: \"f390e74c-c25d-48c3-b820-f78faabb0f11\") " pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:02:04.683691 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.683647 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmvph" Jun 10 01:02:04.690760 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.690731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:02:04.693781 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.693755 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:02:04.704100 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.704075 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:02:04.714574 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.714538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8vb8\" (UniqueName: \"kubernetes.io/projected/0f45ef65-20f3-4cd3-aab9-8117c4d49646-kube-api-access-n8vb8\") pod \"network-check-target-xrnmt\" (UID: \"0f45ef65-20f3-4cd3-aab9-8117c4d49646\") " pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:02:04.805594 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.805562 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wmvph"] Jun 10 01:02:04.808642 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:02:04.808613 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf390e74c_c25d_48c3_b820_f78faabb0f11.slice/crio-22298a08eb745952bdef460c9b3343e3d633c14f2429abf448e61f0a1c37fc6a WatchSource:0}: Error finding container 22298a08eb745952bdef460c9b3343e3d633c14f2429abf448e61f0a1c37fc6a: Status 404 returned error can't find the container with id 22298a08eb745952bdef460c9b3343e3d633c14f2429abf448e61f0a1c37fc6a Jun 10 01:02:04.900216 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.900128 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zlvbp\"" Jun 10 01:02:04.908128 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:04.908104 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:02:05.032904 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:05.030417 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xrnmt"] Jun 10 01:02:05.236373 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:05.236338 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xrnmt" event={"ID":"0f45ef65-20f3-4cd3-aab9-8117c4d49646","Type":"ContainerStarted","Data":"bfc4bbcb0785c2377d7307bf1f441e7fcf7239e6f21dde712f1219c91240a644"} Jun 10 01:02:05.237354 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:05.237328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wmvph" event={"ID":"f390e74c-c25d-48c3-b820-f78faabb0f11","Type":"ContainerStarted","Data":"22298a08eb745952bdef460c9b3343e3d633c14f2429abf448e61f0a1c37fc6a"} Jun 10 01:02:06.201864 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:06.201714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:02:06.202250 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:02:06.201919 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:06.202250 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:02:06.201987 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:38.201966773 +0000 UTC m=+98.779317895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:02:10.251526 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:10.251487 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xrnmt" event={"ID":"0f45ef65-20f3-4cd3-aab9-8117c4d49646","Type":"ContainerStarted","Data":"1598f0f63cf8c8c217a9c2f1f2506663120450b827b126fd1e449163bab37e32"} Jun 10 01:02:10.251988 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:10.251551 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:02:10.252960 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:10.252932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wmvph" event={"ID":"f390e74c-c25d-48c3-b820-f78faabb0f11","Type":"ContainerStarted","Data":"ed358de7429ed279a3274dce14d3771e24a5736aaf5748c87e2e486b4fb2c1a5"} Jun 10 01:02:10.284241 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:10.282153 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xrnmt" podStartSLOduration=66.544321308 podStartE2EDuration="1m11.282135767s" totalImagesPullingTime="4.737814459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:10.266588332 +0000 UTC m=+70.843939469" watchObservedRunningTime="2026-06-10 01:02:10.282135767 +0000 UTC m=+70.859486889" Jun 10 01:02:10.284241 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:10.282870 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wmvph" podStartSLOduration=65.310218481 podStartE2EDuration="1m10.282853189s" totalImagesPullingTime="4.972634708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:10.281688571 +0000 UTC m=+70.859039697" watchObservedRunningTime="2026-06-10 01:02:10.282853189 +0000 UTC m=+70.860204315" Jun 10 01:02:38.218170 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:38.218134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:02:38.218635 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:02:38.218317 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:38.218635 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:02:38.218400 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:03:42.218376683 +0000 UTC m=+162.795727801 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:02:41.258317 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:02:41.258286 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xrnmt" Jun 10 01:03:08.622487 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:08.622442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:03:08.623019 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:08.622562 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:03:08.623019 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:08.622614 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs podName:5b69a9f4-8620-4a7c-adaa-4a20f0e6c675 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:10.622600526 +0000 UTC m=+251.199951629 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs") pod "network-metrics-daemon-t9m95" (UID: "5b69a9f4-8620-4a7c-adaa-4a20f0e6c675") : secret "metrics-daemon-secret" not found Jun 10 01:03:21.867768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:21.867718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:37.353812 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:37.353770 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfddt" podUID="2caca382-1d26-40ad-91ec-515564f2319c" Jun 10 01:03:37.450952 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:37.450917 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfddt" Jun 10 01:03:37.891347 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:37.891306 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t9m95" podUID="5b69a9f4-8620-4a7c-adaa-4a20f0e6c675" Jun 10 01:03:42.253030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:42.252983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:03:42.253452 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:42.253140 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:03:42.253452 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:42.253214 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls podName:2caca382-1d26-40ad-91ec-515564f2319c nodeName:}" failed. No retries permitted until 2026-06-10 01:05:44.253195501 +0000 UTC m=+284.830546622 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls") pod "dns-default-hfddt" (UID: "2caca382-1d26-40ad-91ec-515564f2319c") : secret "dns-default-metrics-tls" not found Jun 10 01:03:46.958152 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.958114 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p"] Jun 10 01:03:46.959900 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.959869 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-vj4pt"] Jun 10 01:03:46.960006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.959987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:46.961416 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.961399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:46.962334 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.962315 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 01:03:46.962431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.962345 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hmx56\"" Jun 10 01:03:46.963001 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.962975 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:03:46.963104 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.963083 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 01:03:46.964430 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.964415 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 01:03:46.964850 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.964834 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:03:46.965116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.965067 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lkfln\"" Jun 10 01:03:46.965220 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.965149 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 01:03:46.965959 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.965941 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 01:03:46.970061 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.970042 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 01:03:46.974601 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.974574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p"] Jun 10 01:03:46.977267 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:46.977246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-vj4pt"] Jun 10 01:03:47.050956 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.050914 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn"] Jun 10 01:03:47.052656 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.052641 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.055291 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.055263 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 01:03:47.055533 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.055515 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-khgx9\"" Jun 10 01:03:47.055696 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.055670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 01:03:47.056050 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.056033 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc"] Jun 10 01:03:47.057940 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.057921 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-674d5448f-c27fw"] Jun 10 01:03:47.058069 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.058050 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.059544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.059528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.060253 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.060237 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 01:03:47.060746 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.060727 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2r4w6\"" Jun 10 01:03:47.060746 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.060741 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 01:03:47.061836 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.061820 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 01:03:47.061921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.061868 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 01:03:47.062273 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062259 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 01:03:47.062357 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062341 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 01:03:47.062607 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062591 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 01:03:47.062665 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062593 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ngstf\"" Jun 10 01:03:47.062914 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062896 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 01:03:47.062914 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 01:03:47.063081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.062905 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 01:03:47.066770 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.066746 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn"] Jun 10 01:03:47.070507 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.070480 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc"] Jun 10 01:03:47.073421 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.073396 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-674d5448f-c27fw"] Jun 10 01:03:47.084759 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.084733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/369c289b-16d2-4be8-8cc8-0f80271e4e38-trusted-ca\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.084895 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.084767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9svbs\" (UniqueName: \"kubernetes.io/projected/050c4e57-b4fc-4eb7-8fd2-40adb53df427-kube-api-access-9svbs\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:47.084895 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.084787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmq8d\" (UniqueName: \"kubernetes.io/projected/369c289b-16d2-4be8-8cc8-0f80271e4e38-kube-api-access-gmq8d\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.084895 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.084850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/369c289b-16d2-4be8-8cc8-0f80271e4e38-config\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.085007 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.084959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:47.085007 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.084989 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/369c289b-16d2-4be8-8cc8-0f80271e4e38-serving-cert\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.186029 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.185990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/369c289b-16d2-4be8-8cc8-0f80271e4e38-config\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.186029 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.186296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.186296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:47.186296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/369c289b-16d2-4be8-8cc8-0f80271e4e38-serving-cert\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.186296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wn6f\" (UniqueName: \"kubernetes.io/projected/25baebd5-131e-4414-902f-1582b10ca57f-kube-api-access-9wn6f\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.186296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.186318 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.186394 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls podName:050c4e57-b4fc-4eb7-8fd2-40adb53df427 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:47.686374848 +0000 UTC m=+168.263725964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w7r2p" (UID: "050c4e57-b4fc-4eb7-8fd2-40adb53df427") : secret "samples-operator-tls" not found Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f748de4b-16f7-4253-9d1a-010c3341ad3d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmx94\" (UniqueName: \"kubernetes.io/projected/f748de4b-16f7-4253-9d1a-010c3341ad3d-kube-api-access-wmx94\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/369c289b-16d2-4be8-8cc8-0f80271e4e38-trusted-ca\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9svbs\" (UniqueName: \"kubernetes.io/projected/050c4e57-b4fc-4eb7-8fd2-40adb53df427-kube-api-access-9svbs\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:47.186542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmq8d\" (UniqueName: \"kubernetes.io/projected/369c289b-16d2-4be8-8cc8-0f80271e4e38-kube-api-access-gmq8d\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.187043 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186553 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-default-certificate\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.187043 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-stats-auth\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.187043 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.186855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/369c289b-16d2-4be8-8cc8-0f80271e4e38-config\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.187376 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.187356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/369c289b-16d2-4be8-8cc8-0f80271e4e38-trusted-ca\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.188721 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.188704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/369c289b-16d2-4be8-8cc8-0f80271e4e38-serving-cert\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.194117 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.194089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:47.196385 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.196354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9svbs\" (UniqueName: \"kubernetes.io/projected/050c4e57-b4fc-4eb7-8fd2-40adb53df427-kube-api-access-9svbs\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:47.196600 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.196581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmq8d\" (UniqueName: \"kubernetes.io/projected/369c289b-16d2-4be8-8cc8-0f80271e4e38-kube-api-access-gmq8d\") pod \"console-operator-668fdbf85c-vj4pt\" (UID: \"369c289b-16d2-4be8-8cc8-0f80271e4e38\") " pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.276366 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.276285 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:47.287836 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.287806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.287970 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.287854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.287970 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.287894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f748de4b-16f7-4253-9d1a-010c3341ad3d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.287970 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.287916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmx94\" (UniqueName: \"kubernetes.io/projected/f748de4b-16f7-4253-9d1a-010c3341ad3d-kube-api-access-wmx94\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.287970 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.287947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-default-certificate\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.288167 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.287985 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:03:47.288167 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.287986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-stats-auth\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.288167 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.288059 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert podName:e3430e8f-1d03-4c64-a3db-5ec21899c9d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:47.788036535 +0000 UTC m=+168.365387656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cwtdn" (UID: "e3430e8f-1d03-4c64-a3db-5ec21899c9d2") : secret "networking-console-plugin-cert" not found Jun 10 01:03:47.288167 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.288127 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:47.788104126 +0000 UTC m=+168.365455229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : configmap references non-existent config key: service-ca.crt Jun 10 01:03:47.288369 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.288184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.288369 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.288235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.288369 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.288298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wn6f\" (UniqueName: \"kubernetes.io/projected/25baebd5-131e-4414-902f-1582b10ca57f-kube-api-access-9wn6f\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.288369 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.288320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.288545 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.288389 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:03:47.288545 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.288393 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:47.288545 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.288459 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls podName:f748de4b-16f7-4253-9d1a-010c3341ad3d nodeName:}" failed. No retries permitted until 2026-06-10 01:03:47.78844454 +0000 UTC m=+168.365795659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-smddc" (UID: "f748de4b-16f7-4253-9d1a-010c3341ad3d") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:47.288545 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.288481 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:47.788471063 +0000 UTC m=+168.365822184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : secret "router-metrics-certs-default" not found Jun 10 01:03:47.288686 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.288647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f748de4b-16f7-4253-9d1a-010c3341ad3d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.289033 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.289012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.290856 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.290827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-stats-auth\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.291323 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.291300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-default-certificate\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.292270 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.292240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:47.296322 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.296300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wn6f\" (UniqueName: \"kubernetes.io/projected/25baebd5-131e-4414-902f-1582b10ca57f-kube-api-access-9wn6f\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.296423 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.296300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmx94\" (UniqueName: \"kubernetes.io/projected/f748de4b-16f7-4253-9d1a-010c3341ad3d-kube-api-access-wmx94\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.396702 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.396662 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-vj4pt"] Jun 10 01:03:47.401327 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:03:47.401302 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369c289b_16d2_4be8_8cc8_0f80271e4e38.slice/crio-f380bbad6cab6c09b96c95e5a44241805d183875971b6b1ce5386bbc9a067442 WatchSource:0}: Error finding container f380bbad6cab6c09b96c95e5a44241805d183875971b6b1ce5386bbc9a067442: Status 404 returned error can't find the container with id f380bbad6cab6c09b96c95e5a44241805d183875971b6b1ce5386bbc9a067442 Jun 10 01:03:47.476222 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.476187 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" event={"ID":"369c289b-16d2-4be8-8cc8-0f80271e4e38","Type":"ContainerStarted","Data":"f380bbad6cab6c09b96c95e5a44241805d183875971b6b1ce5386bbc9a067442"} Jun 10 01:03:47.691765 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.691671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:47.691918 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.691782 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:03:47.691918 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.691850 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls podName:050c4e57-b4fc-4eb7-8fd2-40adb53df427 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:48.691832389 +0000 UTC m=+169.269183511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w7r2p" (UID: "050c4e57-b4fc-4eb7-8fd2-40adb53df427") : secret "samples-operator-tls" not found Jun 10 01:03:47.792694 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.792657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:47.792694 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.792699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.792908 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.792742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:47.792908 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:47.792764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:47.792908 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792815 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:47.792908 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792896 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls podName:f748de4b-16f7-4253-9d1a-010c3341ad3d nodeName:}" failed. No retries permitted until 2026-06-10 01:03:48.792864061 +0000 UTC m=+169.370215164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-smddc" (UID: "f748de4b-16f7-4253-9d1a-010c3341ad3d") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:47.792908 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792896 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:03:47.792908 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792912 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:48.792906054 +0000 UTC m=+169.370257156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : configmap references non-existent config key: service-ca.crt Jun 10 01:03:47.793133 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792948 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert podName:e3430e8f-1d03-4c64-a3db-5ec21899c9d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:48.792932816 +0000 UTC m=+169.370283920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cwtdn" (UID: "e3430e8f-1d03-4c64-a3db-5ec21899c9d2") : secret "networking-console-plugin-cert" not found Jun 10 01:03:47.793133 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792896 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:03:47.793133 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:47.792993 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:48.79298136 +0000 UTC m=+169.370332466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : secret "router-metrics-certs-default" not found Jun 10 01:03:48.701474 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:48.701432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:48.701905 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.701549 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:03:48.701905 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.701603 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls podName:050c4e57-b4fc-4eb7-8fd2-40adb53df427 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:50.701588916 +0000 UTC m=+171.278940018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w7r2p" (UID: "050c4e57-b4fc-4eb7-8fd2-40adb53df427") : secret "samples-operator-tls" not found Jun 10 01:03:48.801896 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:48.801851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:48.802055 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:48.801935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:48.802055 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:48.801962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:48.802055 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:48.801996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:48.802055 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802000 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:03:48.802185 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802080 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:48.802185 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802087 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:50.802069232 +0000 UTC m=+171.379420351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : secret "router-metrics-certs-default" not found Jun 10 01:03:48.802185 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802087 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:03:48.802185 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802111 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:50.802094299 +0000 UTC m=+171.379445401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : configmap references non-existent config key: service-ca.crt Jun 10 01:03:48.802185 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802134 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls podName:f748de4b-16f7-4253-9d1a-010c3341ad3d nodeName:}" failed. No retries permitted until 2026-06-10 01:03:50.802124037 +0000 UTC m=+171.379475141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-smddc" (UID: "f748de4b-16f7-4253-9d1a-010c3341ad3d") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:48.802185 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:48.802151 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert podName:e3430e8f-1d03-4c64-a3db-5ec21899c9d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:50.802142533 +0000 UTC m=+171.379493641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cwtdn" (UID: "e3430e8f-1d03-4c64-a3db-5ec21899c9d2") : secret "networking-console-plugin-cert" not found Jun 10 01:03:48.871381 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:48.871343 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:03:49.860223 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:49.860190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:49.961142 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:49.961110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:50.718080 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:50.718025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:50.718254 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.718205 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:03:50.718290 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.718272 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls podName:050c4e57-b4fc-4eb7-8fd2-40adb53df427 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:54.718255408 +0000 UTC m=+175.295606512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w7r2p" (UID: "050c4e57-b4fc-4eb7-8fd2-40adb53df427") : secret "samples-operator-tls" not found Jun 10 01:03:50.819202 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:50.819115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:50.819202 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:50.819179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:50.819327 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:50.819216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:50.819327 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:50.819239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:50.819327 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819273 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:03:50.819419 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819357 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:50.819419 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819355 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert podName:e3430e8f-1d03-4c64-a3db-5ec21899c9d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:54.819333537 +0000 UTC m=+175.396684643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cwtdn" (UID: "e3430e8f-1d03-4c64-a3db-5ec21899c9d2") : secret "networking-console-plugin-cert" not found Jun 10 01:03:50.819419 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819378 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:03:50.819419 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819396 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:54.81938644 +0000 UTC m=+175.396737548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : configmap references non-existent config key: service-ca.crt Jun 10 01:03:50.819419 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819411 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls podName:f748de4b-16f7-4253-9d1a-010c3341ad3d nodeName:}" failed. No retries permitted until 2026-06-10 01:03:54.819402673 +0000 UTC m=+175.396753782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-smddc" (UID: "f748de4b-16f7-4253-9d1a-010c3341ad3d") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:50.819603 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:50.819424 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:03:54.819417385 +0000 UTC m=+175.396768488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : secret "router-metrics-certs-default" not found Jun 10 01:03:51.487174 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:51.487147 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/0.log" Jun 10 01:03:51.487529 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:51.487189 2565 generic.go:356] "Generic (PLEG): container finished" podID="369c289b-16d2-4be8-8cc8-0f80271e4e38" containerID="4bdb43c731fcdafc54384d3872a94c121397701402fa629751eb19d590eebded" exitCode=255 Jun 10 01:03:51.487529 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:51.487224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" event={"ID":"369c289b-16d2-4be8-8cc8-0f80271e4e38","Type":"ContainerDied","Data":"4bdb43c731fcdafc54384d3872a94c121397701402fa629751eb19d590eebded"} Jun 10 01:03:51.487529 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:51.487439 2565 scope.go:117] "RemoveContainer" containerID="4bdb43c731fcdafc54384d3872a94c121397701402fa629751eb19d590eebded" Jun 10 01:03:52.127503 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.127466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.176092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.176058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.364002 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.363966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.464272 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.464235 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.491805 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.491777 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:03:52.492246 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.492227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/0.log" Jun 10 01:03:52.492308 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.492275 2565 generic.go:356] "Generic (PLEG): container finished" podID="369c289b-16d2-4be8-8cc8-0f80271e4e38" containerID="8af7f2d331408142a6b7d7bec14d4487f148f4b917d4ece36b93448015c12fe3" exitCode=255 Jun 10 01:03:52.492368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.492337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" event={"ID":"369c289b-16d2-4be8-8cc8-0f80271e4e38","Type":"ContainerDied","Data":"8af7f2d331408142a6b7d7bec14d4487f148f4b917d4ece36b93448015c12fe3"} Jun 10 01:03:52.492423 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.492391 2565 scope.go:117] "RemoveContainer" containerID="4bdb43c731fcdafc54384d3872a94c121397701402fa629751eb19d590eebded" Jun 10 01:03:52.492599 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.492583 2565 scope.go:117] "RemoveContainer" containerID="8af7f2d331408142a6b7d7bec14d4487f148f4b917d4ece36b93448015c12fe3" Jun 10 01:03:52.492763 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:52.492744 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-vj4pt_openshift-console-operator(369c289b-16d2-4be8-8cc8-0f80271e4e38)\"" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" podUID="369c289b-16d2-4be8-8cc8-0f80271e4e38" Jun 10 01:03:52.564779 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.564742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.592792 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.592749 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn"] Jun 10 01:03:52.595343 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.595321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" Jun 10 01:03:52.597584 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.597554 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2jzzv\"" Jun 10 01:03:52.597706 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.597595 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 01:03:52.597706 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.597669 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 01:03:52.606649 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.606626 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn"] Jun 10 01:03:52.665155 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.665116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.736317 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.736230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xrm5\" (UniqueName: \"kubernetes.io/projected/a5b12865-87b9-4188-bc0d-e0022108ba5e-kube-api-access-8xrm5\") pod \"migrator-955ffdf5f-p9xjn\" (UID: \"a5b12865-87b9-4188-bc0d-e0022108ba5e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" Jun 10 01:03:52.765673 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.765635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.836856 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.836811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xrm5\" (UniqueName: \"kubernetes.io/projected/a5b12865-87b9-4188-bc0d-e0022108ba5e-kube-api-access-8xrm5\") pod \"migrator-955ffdf5f-p9xjn\" (UID: \"a5b12865-87b9-4188-bc0d-e0022108ba5e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" Jun 10 01:03:52.844188 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.844166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xrm5\" (UniqueName: \"kubernetes.io/projected/a5b12865-87b9-4188-bc0d-e0022108ba5e-kube-api-access-8xrm5\") pod \"migrator-955ffdf5f-p9xjn\" (UID: \"a5b12865-87b9-4188-bc0d-e0022108ba5e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" Jun 10 01:03:52.865825 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.865785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:52.904081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.904036 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" Jun 10 01:03:52.968146 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:52.968111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:53.026972 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:53.026870 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn"] Jun 10 01:03:53.030695 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:03:53.030667 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b12865_87b9_4188_bc0d_e0022108ba5e.slice/crio-65cf368380335d3ce01aa220667cfb6c0a2335b7cbfebfd9c1ab40d1fa2c75a5 WatchSource:0}: Error finding container 65cf368380335d3ce01aa220667cfb6c0a2335b7cbfebfd9c1ab40d1fa2c75a5: Status 404 returned error can't find the container with id 65cf368380335d3ce01aa220667cfb6c0a2335b7cbfebfd9c1ab40d1fa2c75a5 Jun 10 01:03:53.496283 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:53.496247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" event={"ID":"a5b12865-87b9-4188-bc0d-e0022108ba5e","Type":"ContainerStarted","Data":"65cf368380335d3ce01aa220667cfb6c0a2335b7cbfebfd9c1ab40d1fa2c75a5"} Jun 10 01:03:53.497677 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:53.497657 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:03:53.498006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:53.497986 2565 scope.go:117] "RemoveContainer" containerID="8af7f2d331408142a6b7d7bec14d4487f148f4b917d4ece36b93448015c12fe3" Jun 10 01:03:53.498181 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:53.498161 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-vj4pt_openshift-console-operator(369c289b-16d2-4be8-8cc8-0f80271e4e38)\"" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" podUID="369c289b-16d2-4be8-8cc8-0f80271e4e38" Jun 10 01:03:54.202846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.202809 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54cm8_2d1e069d-e288-4697-8f70-6213cef84bf5/dns-node-resolver/0.log" Jun 10 01:03:54.502505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.502415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" event={"ID":"a5b12865-87b9-4188-bc0d-e0022108ba5e","Type":"ContainerStarted","Data":"574cdc47ef31f33c581a2c96e7afd1829c728f92741fcc925969dc2783a1ee46"} Jun 10 01:03:54.502505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.502502 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" event={"ID":"a5b12865-87b9-4188-bc0d-e0022108ba5e","Type":"ContainerStarted","Data":"5c820f7d0d32c54213a92ab74f789c167174668dd1f8065b696735569ac10e65"} Jun 10 01:03:54.516251 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.516185 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-p9xjn" podStartSLOduration=1.272056781 podStartE2EDuration="2.516170447s" totalImagesPullingTime="1.244113666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:54.51601614 +0000 UTC m=+175.093367284" watchObservedRunningTime="2026-06-10 01:03:54.516170447 +0000 UTC m=+175.093521571" Jun 10 01:03:54.533790 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.533755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:54.633751 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.633715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:54.752983 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.752896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:03:54.752983 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.752975 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 01:03:54.753150 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.753036 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls podName:050c4e57-b4fc-4eb7-8fd2-40adb53df427 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:02.753021381 +0000 UTC m=+183.330372485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w7r2p" (UID: "050c4e57-b4fc-4eb7-8fd2-40adb53df427") : secret "samples-operator-tls" not found Jun 10 01:03:54.853829 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.853790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:03:54.853829 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.853834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.853897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:54.853924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.853949 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.853994 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.854013 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.854006 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls podName:f748de4b-16f7-4253-9d1a-010c3341ad3d nodeName:}" failed. No retries permitted until 2026-06-10 01:04:02.853992265 +0000 UTC m=+183.431343368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-smddc" (UID: "f748de4b-16f7-4253-9d1a-010c3341ad3d") : secret "cluster-monitoring-operator-tls" not found Jun 10 01:03:54.854058 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.854054 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert podName:e3430e8f-1d03-4c64-a3db-5ec21899c9d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:02.854041946 +0000 UTC m=+183.431393049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cwtdn" (UID: "e3430e8f-1d03-4c64-a3db-5ec21899c9d2") : secret "networking-console-plugin-cert" not found Jun 10 01:03:54.854281 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.854069 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:04:02.854063379 +0000 UTC m=+183.431414482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : secret "router-metrics-certs-default" not found Jun 10 01:03:54.854281 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:54.854079 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle podName:25baebd5-131e-4414-902f-1582b10ca57f nodeName:}" failed. No retries permitted until 2026-06-10 01:04:02.854073995 +0000 UTC m=+183.431425098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle") pod "router-default-674d5448f-c27fw" (UID: "25baebd5-131e-4414-902f-1582b10ca57f") : configmap references non-existent config key: service-ca.crt Jun 10 01:03:55.202253 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:55.202227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ljgg_b34d5e2e-4115-4802-8f98-8914e2b01e12/node-ca/0.log" Jun 10 01:03:55.280080 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:55.280044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:55.764920 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:55.764866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:55.959352 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:55.959311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:56.002579 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:56.002555 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hh2q_7f152419-a11c-4256-9ecc-778174e1b31c/serve-healthcheck-canary/0.log" Jun 10 01:03:56.060454 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:56.060363 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:56.161463 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:56.161432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:56.261236 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:56.261199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:56.361870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:56.361785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:56.462394 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:56.462367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:57.277244 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:57.277207 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:57.277612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:57.277270 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:03:57.277612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:57.277561 2565 scope.go:117] "RemoveContainer" containerID="8af7f2d331408142a6b7d7bec14d4487f148f4b917d4ece36b93448015c12fe3" Jun 10 01:03:57.277738 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:03:57.277719 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-vj4pt_openshift-console-operator(369c289b-16d2-4be8-8cc8-0f80271e4e38)\"" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" podUID="369c289b-16d2-4be8-8cc8-0f80271e4e38" Jun 10 01:03:57.456593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:57.456551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:57.851285 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:57.851252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:57.953053 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:57.953011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:58.056601 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:58.056567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:58.257203 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:58.257165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:58.457565 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:58.457528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:59.453437 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:59.453394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:59.583058 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:59.583018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:59.683276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:59.683234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:59.851804 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:03:59.851711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:00.055796 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:00.055750 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:00.251931 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:00.251900 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:00.455197 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:00.455151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:01.259520 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:01.259490 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:01.653092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:01.653004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:01.853577 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:01.853531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:02.053960 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.053923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:02.168852 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.168812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:02.269866 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.269831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:02.453523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.453485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:02.817311 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.817218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:04:02.819709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.819688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/050c4e57-b4fc-4eb7-8fd2-40adb53df427-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w7r2p\" (UID: \"050c4e57-b4fc-4eb7-8fd2-40adb53df427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:04:02.873118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.873083 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hmx56\"" Jun 10 01:04:02.881139 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.881115 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" Jun 10 01:04:02.918622 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.918235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:04:02.918622 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.918302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:02.918622 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.918369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:04:02.918622 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.918409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:02.918968 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:04:02.918804 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 01:04:02.918968 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:04:02.918892 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert podName:e3430e8f-1d03-4c64-a3db-5ec21899c9d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:18.918853877 +0000 UTC m=+199.496204980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cwtdn" (UID: "e3430e8f-1d03-4c64-a3db-5ec21899c9d2") : secret "networking-console-plugin-cert" not found Jun 10 01:04:02.919336 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.919311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25baebd5-131e-4414-902f-1582b10ca57f-service-ca-bundle\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:02.921081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.921060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f748de4b-16f7-4253-9d1a-010c3341ad3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-smddc\" (UID: \"f748de4b-16f7-4253-9d1a-010c3341ad3d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:04:02.921383 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.921366 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25baebd5-131e-4414-902f-1582b10ca57f-metrics-certs\") pod \"router-default-674d5448f-c27fw\" (UID: \"25baebd5-131e-4414-902f-1582b10ca57f\") " pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:02.977090 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.977059 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2r4w6\"" Jun 10 01:04:02.985039 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.983466 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ngstf\"" Jun 10 01:04:02.985916 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.985318 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" Jun 10 01:04:02.991248 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:02.991212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:03.012443 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.012411 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p"] Jun 10 01:04:03.120680 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.120638 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc"] Jun 10 01:04:03.124135 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:03.124091 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf748de4b_16f7_4253_9d1a_010c3341ad3d.slice/crio-7fa5348ba03effaca96dc811f8be17b457457d94d65e4b1a5ea706cd63f2f355 WatchSource:0}: Error finding container 7fa5348ba03effaca96dc811f8be17b457457d94d65e4b1a5ea706cd63f2f355: Status 404 returned error can't find the container with id 7fa5348ba03effaca96dc811f8be17b457457d94d65e4b1a5ea706cd63f2f355 Jun 10 01:04:03.143562 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.143532 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-674d5448f-c27fw"] Jun 10 01:04:03.147422 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:03.147391 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25baebd5_131e_4414_902f_1582b10ca57f.slice/crio-77ca5337a2c2cf59e9b19c8ac4193c3195f6bd95609d8aac62630a90dbb44538 WatchSource:0}: Error finding container 77ca5337a2c2cf59e9b19c8ac4193c3195f6bd95609d8aac62630a90dbb44538: Status 404 returned error can't find the container with id 77ca5337a2c2cf59e9b19c8ac4193c3195f6bd95609d8aac62630a90dbb44538 Jun 10 01:04:03.255043 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.255013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:03.531194 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.531157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-674d5448f-c27fw" event={"ID":"25baebd5-131e-4414-902f-1582b10ca57f","Type":"ContainerStarted","Data":"b0327488400873484960abed8124234d1314e3f759d20a6cd2480bb5796d32b2"} Jun 10 01:04:03.531618 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.531218 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-674d5448f-c27fw" event={"ID":"25baebd5-131e-4414-902f-1582b10ca57f","Type":"ContainerStarted","Data":"77ca5337a2c2cf59e9b19c8ac4193c3195f6bd95609d8aac62630a90dbb44538"} Jun 10 01:04:03.532358 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.532335 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" event={"ID":"050c4e57-b4fc-4eb7-8fd2-40adb53df427","Type":"ContainerStarted","Data":"93a9959640d6cfdf0513e0a72319cb65aebbf310ac5248ec041dc27bbc7b3738"} Jun 10 01:04:03.533412 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.533391 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" event={"ID":"f748de4b-16f7-4253-9d1a-010c3341ad3d","Type":"ContainerStarted","Data":"7fa5348ba03effaca96dc811f8be17b457457d94d65e4b1a5ea706cd63f2f355"} Jun 10 01:04:03.550312 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.550200 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-674d5448f-c27fw" podStartSLOduration=16.550183774 podStartE2EDuration="16.550183774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:03.54974663 +0000 UTC m=+184.127097756" watchObservedRunningTime="2026-06-10 01:04:03.550183774 +0000 UTC m=+184.127534899" Jun 10 01:04:03.854506 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.854394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:03.991955 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.991914 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:03.994871 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:03.994844 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:04.050661 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:04.050619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:04.449529 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:04.449499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:04.536923 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:04.536891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:04.538143 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:04.538124 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-674d5448f-c27fw" Jun 10 01:04:04.651928 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:04.651816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:05.050195 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:05.050154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:05.441042 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:05.440954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:05.654324 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:05.654295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:05.868656 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:05.868613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:05.965721 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:05.965686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:06.065742 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.065698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:06.116038 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.116004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:06.544147 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.544104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" event={"ID":"f748de4b-16f7-4253-9d1a-010c3341ad3d","Type":"ContainerStarted","Data":"40283f3b0e1e5a0b2044d5011fa1e7bf6de80e6d9b2c716ec683cc73507984ea"} Jun 10 01:04:06.545725 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.545699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" event={"ID":"050c4e57-b4fc-4eb7-8fd2-40adb53df427","Type":"ContainerStarted","Data":"19467717575c32a2d08dbd3ea30755d5c2cff3f7e381814b2550b1515ba88439"} Jun 10 01:04:06.545846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.545739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" event={"ID":"050c4e57-b4fc-4eb7-8fd2-40adb53df427","Type":"ContainerStarted","Data":"88806d1a266888eeee7a838c3f4bbba6c91cdbb4ffb180f0bcb3bf0ef107d4ff"} Jun 10 01:04:06.561279 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.561227 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-smddc" podStartSLOduration=17.117094474 podStartE2EDuration="19.561211878s" totalImagesPullingTime="2.444117404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:06.560297918 +0000 UTC m=+187.137649045" watchObservedRunningTime="2026-06-10 01:04:06.561211878 +0000 UTC m=+187.138563003" Jun 10 01:04:06.575212 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.575161 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w7r2p" podStartSLOduration=18.070909495 podStartE2EDuration="20.575145083s" totalImagesPullingTime="2.504235588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:06.574277769 +0000 UTC m=+187.151628914" watchObservedRunningTime="2026-06-10 01:04:06.575145083 +0000 UTC m=+187.152496236" Jun 10 01:04:06.663982 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.663935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:06.859871 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:06.859776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:07.872045 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:07.872013 2565 scope.go:117] "RemoveContainer" containerID="8af7f2d331408142a6b7d7bec14d4487f148f4b917d4ece36b93448015c12fe3" Jun 10 01:04:08.554107 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.554076 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:04:08.554313 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.554125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" event={"ID":"369c289b-16d2-4be8-8cc8-0f80271e4e38","Type":"ContainerStarted","Data":"3f779300b5a23c34033352727c7a3df881f230d5427ff13f6b1c1b57a0da3379"} Jun 10 01:04:08.554422 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.554403 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:04:08.559325 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.559301 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" Jun 10 01:04:08.570650 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.570601 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-vj4pt" podStartSLOduration=19.481228455 podStartE2EDuration="22.570585449s" totalImagesPullingTime="3.089356994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:08.569309959 +0000 UTC m=+189.146661099" watchObservedRunningTime="2026-06-10 01:04:08.570585449 +0000 UTC m=+189.147936607" Jun 10 01:04:08.666554 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.666517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:08.768127 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.768082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:08.818597 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.818512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:08.975628 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:08.975588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:09.353983 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:09.353946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:09.406937 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:09.406902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:09.753756 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:09.753718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:09.838900 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:09.838845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:10.164605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:10.164520 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:10.264870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:10.264834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:10.365513 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:10.365482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:12.172042 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:12.172004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:12.272347 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:12.272305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:13.757294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.757259 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kwkd2"] Jun 10 01:04:13.760412 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.760391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.763934 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.763910 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 01:04:13.764059 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.763941 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 01:04:13.764059 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.763910 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 01:04:13.765023 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.765005 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 01:04:13.765310 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.765270 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6l47l\"" Jun 10 01:04:13.777549 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.777507 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwkd2"] Jun 10 01:04:13.808578 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.808536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1eca53e5-fb44-4e3f-9753-022386591761-data-volume\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.808741 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.808594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1eca53e5-fb44-4e3f-9753-022386591761-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.808741 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.808660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1eca53e5-fb44-4e3f-9753-022386591761-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.808741 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.808718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s8hp\" (UniqueName: \"kubernetes.io/projected/1eca53e5-fb44-4e3f-9753-022386591761-kube-api-access-7s8hp\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.808914 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.808772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1eca53e5-fb44-4e3f-9753-022386591761-crio-socket\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.826459 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.826427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:13.910094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1eca53e5-fb44-4e3f-9753-022386591761-data-volume\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1eca53e5-fb44-4e3f-9753-022386591761-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910338 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1eca53e5-fb44-4e3f-9753-022386591761-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910338 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s8hp\" (UniqueName: \"kubernetes.io/projected/1eca53e5-fb44-4e3f-9753-022386591761-kube-api-access-7s8hp\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910338 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1eca53e5-fb44-4e3f-9753-022386591761-crio-socket\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910338 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1eca53e5-fb44-4e3f-9753-022386591761-crio-socket\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910538 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1eca53e5-fb44-4e3f-9753-022386591761-data-volume\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.910801 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.910782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1eca53e5-fb44-4e3f-9753-022386591761-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.912777 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.912757 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1eca53e5-fb44-4e3f-9753-022386591761-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.922737 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.922707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s8hp\" (UniqueName: \"kubernetes.io/projected/1eca53e5-fb44-4e3f-9753-022386591761-kube-api-access-7s8hp\") pod \"insights-runtime-extractor-kwkd2\" (UID: \"1eca53e5-fb44-4e3f-9753-022386591761\") " pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:13.960749 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:13.960712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:14.041828 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:14.041735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:14.070380 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:14.070341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwkd2" Jun 10 01:04:14.197527 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:14.197490 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwkd2"] Jun 10 01:04:14.200768 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:14.200739 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eca53e5_fb44_4e3f_9753_022386591761.slice/crio-1ee08374ebf8f2ceaeb9c89883b98249e1cf3b1a9cbb7ad34d1123bf56f344c7 WatchSource:0}: Error finding container 1ee08374ebf8f2ceaeb9c89883b98249e1cf3b1a9cbb7ad34d1123bf56f344c7: Status 404 returned error can't find the container with id 1ee08374ebf8f2ceaeb9c89883b98249e1cf3b1a9cbb7ad34d1123bf56f344c7 Jun 10 01:04:14.574462 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:14.574430 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwkd2" event={"ID":"1eca53e5-fb44-4e3f-9753-022386591761","Type":"ContainerStarted","Data":"e2b5cecdd6d79d944baed09b88285fa65032f4f5f758ebadbee02a40eb4eb0e0"} Jun 10 01:04:14.574631 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:14.574484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwkd2" event={"ID":"1eca53e5-fb44-4e3f-9753-022386591761","Type":"ContainerStarted","Data":"1ee08374ebf8f2ceaeb9c89883b98249e1cf3b1a9cbb7ad34d1123bf56f344c7"} Jun 10 01:04:15.579410 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:15.579374 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwkd2" event={"ID":"1eca53e5-fb44-4e3f-9753-022386591761","Type":"ContainerStarted","Data":"d78868cd7fc3efa6c54ace8e771b1ce3daf46ef0d0fcf7187e7a9bbf61be1095"} Jun 10 01:04:17.083168 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.083128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:17.121540 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.121485 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg"] Jun 10 01:04:17.127963 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.127939 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.130346 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.130316 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 01:04:17.130531 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.130497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 01:04:17.131471 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.131448 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 01:04:17.131471 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.131461 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zwbhg\"" Jun 10 01:04:17.135264 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.135240 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg"] Jun 10 01:04:17.150613 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.150579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:17.236949 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.236899 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.237091 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.236992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a035ed0f-ed46-4578-a73c-405a2072144e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.237091 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.237083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.237189 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.237110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb99q\" (UniqueName: \"kubernetes.io/projected/a035ed0f-ed46-4578-a73c-405a2072144e-kube-api-access-xb99q\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.337804 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.337775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.337943 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.337812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb99q\" (UniqueName: \"kubernetes.io/projected/a035ed0f-ed46-4578-a73c-405a2072144e-kube-api-access-xb99q\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.337943 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.337850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.337943 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.337924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a035ed0f-ed46-4578-a73c-405a2072144e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.338103 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:04:17.338023 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 10 01:04:17.338153 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:04:17.338112 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-tls podName:a035ed0f-ed46-4578-a73c-405a2072144e nodeName:}" failed. No retries permitted until 2026-06-10 01:04:17.838090708 +0000 UTC m=+198.415441832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-qkrbg" (UID: "a035ed0f-ed46-4578-a73c-405a2072144e") : secret "prometheus-operator-tls" not found Jun 10 01:04:17.338522 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.338503 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a035ed0f-ed46-4578-a73c-405a2072144e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.340171 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.340153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.350930 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.350911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb99q\" (UniqueName: \"kubernetes.io/projected/a035ed0f-ed46-4578-a73c-405a2072144e-kube-api-access-xb99q\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.402399 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.402354 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:17.587292 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.587206 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwkd2" event={"ID":"1eca53e5-fb44-4e3f-9753-022386591761","Type":"ContainerStarted","Data":"43aa991bb12260587a4501122e659d3fd45e797ddf94a2f630b6205a690eba01"} Jun 10 01:04:17.605417 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.605368 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kwkd2" podStartSLOduration=1.610925855 podStartE2EDuration="4.605351067s" totalImagesPullingTime="2.994425212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:04:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:17.604449206 +0000 UTC m=+198.181800331" watchObservedRunningTime="2026-06-10 01:04:17.605351067 +0000 UTC m=+198.182702192" Jun 10 01:04:17.842592 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.842482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:17.844995 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:17.844969 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a035ed0f-ed46-4578-a73c-405a2072144e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qkrbg\" (UID: \"a035ed0f-ed46-4578-a73c-405a2072144e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:18.039761 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:18.039724 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" Jun 10 01:04:18.167134 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:18.167108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg"] Jun 10 01:04:18.169219 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:18.169189 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda035ed0f_ed46_4578_a73c_405a2072144e.slice/crio-5c8c56d5e0a167589a36a711aaa43d7343f51fc08f1cb57098687e6af1b806bf WatchSource:0}: Error finding container 5c8c56d5e0a167589a36a711aaa43d7343f51fc08f1cb57098687e6af1b806bf: Status 404 returned error can't find the container with id 5c8c56d5e0a167589a36a711aaa43d7343f51fc08f1cb57098687e6af1b806bf Jun 10 01:04:18.592280 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:18.592240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" event={"ID":"a035ed0f-ed46-4578-a73c-405a2072144e","Type":"ContainerStarted","Data":"5c8c56d5e0a167589a36a711aaa43d7343f51fc08f1cb57098687e6af1b806bf"} Jun 10 01:04:18.953197 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:18.953159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:04:18.956040 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:18.956008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3430e8f-1d03-4c64-a3db-5ec21899c9d2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cwtdn\" (UID: \"e3430e8f-1d03-4c64-a3db-5ec21899c9d2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:04:19.164843 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:19.164808 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-khgx9\"" Jun 10 01:04:19.172999 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:19.172950 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" Jun 10 01:04:19.327544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:19.327512 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn"] Jun 10 01:04:19.330841 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:19.330815 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3430e8f_1d03_4c64_a3db_5ec21899c9d2.slice/crio-e8876f30b63f6e7ce523951e82060c34870d0da2ea6cf45f7d05a8c5259245fd WatchSource:0}: Error finding container e8876f30b63f6e7ce523951e82060c34870d0da2ea6cf45f7d05a8c5259245fd: Status 404 returned error can't find the container with id e8876f30b63f6e7ce523951e82060c34870d0da2ea6cf45f7d05a8c5259245fd Jun 10 01:04:19.596696 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:19.596620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" event={"ID":"e3430e8f-1d03-4c64-a3db-5ec21899c9d2","Type":"ContainerStarted","Data":"e8876f30b63f6e7ce523951e82060c34870d0da2ea6cf45f7d05a8c5259245fd"} Jun 10 01:04:20.216157 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:20.216028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:20.578198 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:20.578079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:20.603859 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:20.603821 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" event={"ID":"a035ed0f-ed46-4578-a73c-405a2072144e","Type":"ContainerStarted","Data":"0907dc712d207aaa35f27628eb3b53f7c57aaee006056e04cfc75e72596f7297"} Jun 10 01:04:20.604035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:20.603933 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" event={"ID":"a035ed0f-ed46-4578-a73c-405a2072144e","Type":"ContainerStarted","Data":"7646a5e5c477248169461b782b739e7a5790c9b06ba92ae3c08da013b5c6205d"} Jun 10 01:04:20.620526 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:20.620475 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qkrbg" podStartSLOduration=1.839796979 podStartE2EDuration="3.620460972s" totalImagesPullingTime="1.780663993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:20.61936795 +0000 UTC m=+201.196719097" watchObservedRunningTime="2026-06-10 01:04:20.620460972 +0000 UTC m=+201.197812097" Jun 10 01:04:20.630783 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:20.630748 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:21.608267 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:21.608226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" event={"ID":"e3430e8f-1d03-4c64-a3db-5ec21899c9d2","Type":"ContainerStarted","Data":"bc3b0bdd8dfeb1f9b1245f6a3994be4d06d46d020caee4df54062ae53a262fd0"} Jun 10 01:04:21.625005 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:21.624950 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cwtdn" podStartSLOduration=33.166270468 podStartE2EDuration="34.624928841s" totalImagesPullingTime="1.458658373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:21.623929543 +0000 UTC m=+202.201280665" watchObservedRunningTime="2026-06-10 01:04:21.624928841 +0000 UTC m=+202.202279966" Jun 10 01:04:21.708017 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:21.707974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:21.763927 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:21.763892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.203271 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.203234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.414665 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.414630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.452563 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.452530 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-km98j"] Jun 10 01:04:22.456946 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.456851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.459312 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.459287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 01:04:22.459450 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.459287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lqwcs\"" Jun 10 01:04:22.459539 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.459525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 01:04:22.459600 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.459549 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 01:04:22.462069 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.462046 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5"] Jun 10 01:04:22.465310 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.465290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.467492 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.467462 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 01:04:22.467591 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.467575 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 01:04:22.467899 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.467866 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pm2tx\"" Jun 10 01:04:22.468039 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.468022 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 01:04:22.479086 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.479065 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5"] Jun 10 01:04:22.501007 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.500968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.555217 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.555180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.582275 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6645236f-5b1e-4b72-94ec-a60fa26d7002-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.582275 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-accelerators-collector-config\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkxm\" (UniqueName: \"kubernetes.io/projected/e0ba70ae-0548-4863-bdb6-e94715a3c57d-kube-api-access-czkxm\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-sys\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-tls\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0ba70ae-0548-4863-bdb6-e94715a3c57d-metrics-client-ca\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq29b\" (UniqueName: \"kubernetes.io/projected/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-api-access-mq29b\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.582646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-wtmp\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.582646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.582646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-root\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-textfile\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.582782 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6645236f-5b1e-4b72-94ec-a60fa26d7002-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.582782 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.582695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.655577 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.655536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.683644 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.683830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.683830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-root\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.683830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-textfile\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.683830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6645236f-5b1e-4b72-94ec-a60fa26d7002-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.683830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-root\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.683984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6645236f-5b1e-4b72-94ec-a60fa26d7002-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-accelerators-collector-config\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czkxm\" (UniqueName: \"kubernetes.io/projected/e0ba70ae-0548-4863-bdb6-e94715a3c57d-kube-api-access-czkxm\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-sys\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-textfile\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-tls\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0ba70ae-0548-4863-bdb6-e94715a3c57d-metrics-client-ca\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:04:22.684270 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq29b\" (UniqueName: \"kubernetes.io/projected/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-api-access-mq29b\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:04:22.684336 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-tls podName:e0ba70ae-0548-4863-bdb6-e94715a3c57d nodeName:}" failed. No retries permitted until 2026-06-10 01:04:23.18431635 +0000 UTC m=+203.761667472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-tls") pod "node-exporter-km98j" (UID: "e0ba70ae-0548-4863-bdb6-e94715a3c57d") : secret "node-exporter-tls" not found Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-wtmp\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6645236f-5b1e-4b72-94ec-a60fa26d7002-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-wtmp\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0ba70ae-0548-4863-bdb6-e94715a3c57d-sys\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6645236f-5b1e-4b72-94ec-a60fa26d7002-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.685846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.685846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.684770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0ba70ae-0548-4863-bdb6-e94715a3c57d-metrics-client-ca\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.685846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.685059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-accelerators-collector-config\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.687039 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.687015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.687241 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.687220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.687581 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.687557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.696934 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.696908 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq29b\" (UniqueName: \"kubernetes.io/projected/6645236f-5b1e-4b72-94ec-a60fa26d7002-kube-api-access-mq29b\") pod \"kube-state-metrics-57bbf8bfb5-sj9w5\" (UID: \"6645236f-5b1e-4b72-94ec-a60fa26d7002\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.697474 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.697436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkxm\" (UniqueName: \"kubernetes.io/projected/e0ba70ae-0548-4863-bdb6-e94715a3c57d-kube-api-access-czkxm\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:22.756194 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.756100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.774206 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.774174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" Jun 10 01:04:22.856671 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.856615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.904418 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.904390 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5"] Jun 10 01:04:22.906644 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:22.906613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:22.907125 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:22.907103 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6645236f_5b1e_4b72_94ec_a60fa26d7002.slice/crio-60365a283f275057d94387ec0112aa0f29885a67345c04d8440afa4f88764bcb WatchSource:0}: Error finding container 60365a283f275057d94387ec0112aa0f29885a67345c04d8440afa4f88764bcb: Status 404 returned error can't find the container with id 60365a283f275057d94387ec0112aa0f29885a67345c04d8440afa4f88764bcb Jun 10 01:04:23.189723 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.189640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-tls\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:23.192305 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.192272 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0ba70ae-0548-4863-bdb6-e94715a3c57d-node-exporter-tls\") pod \"node-exporter-km98j\" (UID: \"e0ba70ae-0548-4863-bdb6-e94715a3c57d\") " pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:23.240465 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.240426 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:23.366506 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.366472 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-km98j" Jun 10 01:04:23.379726 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:23.379697 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ba70ae_0548_4863_bdb6_e94715a3c57d.slice/crio-6a70b49acfb848d5f33062d843bb97dadb066a108a2fcdd884d3c28f005d254c WatchSource:0}: Error finding container 6a70b49acfb848d5f33062d843bb97dadb066a108a2fcdd884d3c28f005d254c: Status 404 returned error can't find the container with id 6a70b49acfb848d5f33062d843bb97dadb066a108a2fcdd884d3c28f005d254c Jun 10 01:04:23.427827 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.427786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:23.516085 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.516039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:23.617237 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.617195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" event={"ID":"6645236f-5b1e-4b72-94ec-a60fa26d7002","Type":"ContainerStarted","Data":"60365a283f275057d94387ec0112aa0f29885a67345c04d8440afa4f88764bcb"} Jun 10 01:04:23.618618 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.618581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-km98j" event={"ID":"e0ba70ae-0548-4863-bdb6-e94715a3c57d","Type":"ContainerStarted","Data":"6a70b49acfb848d5f33062d843bb97dadb066a108a2fcdd884d3c28f005d254c"} Jun 10 01:04:23.939533 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.939445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:23.973742 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.973705 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848688f45d-xgz99"] Jun 10 01:04:23.977979 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.977937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:23.980431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.980406 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 01:04:23.981448 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981424 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 01:04:23.981575 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981515 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 01:04:23.981710 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981691 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvfzk\"" Jun 10 01:04:23.981710 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 01:04:23.981837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981727 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 01:04:23.981837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981691 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 01:04:23.981965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.981835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 01:04:23.989165 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.987991 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848688f45d-xgz99"] Jun 10 01:04:23.989165 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:23.988195 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 01:04:24.096669 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gkbs\" (UniqueName: \"kubernetes.io/projected/a2dc536d-5499-457e-aaab-55c10c0f24dc-kube-api-access-9gkbs\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.096837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-serving-cert\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.096837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-service-ca\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.096837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-config\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.097014 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-oauth-serving-cert\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.097014 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-trusted-ca-bundle\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.097014 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.096971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-oauth-config\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198353 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-trusted-ca-bundle\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198535 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-oauth-config\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198535 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gkbs\" (UniqueName: \"kubernetes.io/projected/a2dc536d-5499-457e-aaab-55c10c0f24dc-kube-api-access-9gkbs\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198535 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-serving-cert\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198535 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-service-ca\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198751 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-config\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.198751 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.198563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-oauth-serving-cert\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.199368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.199332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-oauth-serving-cert\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.199471 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.199362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-trusted-ca-bundle\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.199471 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.199411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-service-ca\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.199581 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.199468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-config\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.201764 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.201743 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-oauth-config\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.201905 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.201859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-serving-cert\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.206378 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.206355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gkbs\" (UniqueName: \"kubernetes.io/projected/a2dc536d-5499-457e-aaab-55c10c0f24dc-kube-api-access-9gkbs\") pod \"console-848688f45d-xgz99\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.293009 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.292970 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:24.378320 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.378276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:24.432236 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.432200 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-747cfdd66f-wldkz"] Jun 10 01:04:24.436719 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.436689 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.439225 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 01:04:24.439368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439251 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ldx2p\"" Jun 10 01:04:24.439368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439261 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 01:04:24.439368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-27sk2nl07gik0\"" Jun 10 01:04:24.439368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 01:04:24.439368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 01:04:24.439368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.439213 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 01:04:24.445751 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.445712 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-747cfdd66f-wldkz"] Jun 10 01:04:24.602534 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/760ff3d5-e577-43be-98de-0090c3da7ccd-metrics-client-ca\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602607 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602607 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxwn\" (UniqueName: \"kubernetes.io/projected/760ff3d5-e577-43be-98de-0090c3da7ccd-kube-api-access-dbxwn\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602699 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-grpc-tls\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602699 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-tls\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.602842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.602750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703623 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-tls\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703755 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703755 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703755 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/760ff3d5-e577-43be-98de-0090c3da7ccd-metrics-client-ca\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703755 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703977 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxwn\" (UniqueName: \"kubernetes.io/projected/760ff3d5-e577-43be-98de-0090c3da7ccd-kube-api-access-dbxwn\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703977 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-grpc-tls\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.703977 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.703919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.705018 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.704794 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/760ff3d5-e577-43be-98de-0090c3da7ccd-metrics-client-ca\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.708679 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.708197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.708679 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.708330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.708679 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.708594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.708679 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.708622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.710323 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.709757 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-grpc-tls\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.710323 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.710298 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/760ff3d5-e577-43be-98de-0090c3da7ccd-secret-thanos-querier-tls\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.715232 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.713135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxwn\" (UniqueName: \"kubernetes.io/projected/760ff3d5-e577-43be-98de-0090c3da7ccd-kube-api-access-dbxwn\") pod \"thanos-querier-747cfdd66f-wldkz\" (UID: \"760ff3d5-e577-43be-98de-0090c3da7ccd\") " pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.740440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.740404 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848688f45d-xgz99"] Jun 10 01:04:24.746041 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:24.745987 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2dc536d_5499_457e_aaab_55c10c0f24dc.slice/crio-afd07da6677c585bf8e96e32c7ff8e3db0105270091c9a376fd49639ddf9c71d WatchSource:0}: Error finding container afd07da6677c585bf8e96e32c7ff8e3db0105270091c9a376fd49639ddf9c71d: Status 404 returned error can't find the container with id afd07da6677c585bf8e96e32c7ff8e3db0105270091c9a376fd49639ddf9c71d Jun 10 01:04:24.748824 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.748619 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:24.918259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:24.918236 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-747cfdd66f-wldkz"] Jun 10 01:04:24.920982 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:24.920940 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760ff3d5_e577_43be_98de_0090c3da7ccd.slice/crio-391ab920619e321155dafa73d8d47a81b8dfcc69561a84d6fb1cf493146174ed WatchSource:0}: Error finding container 391ab920619e321155dafa73d8d47a81b8dfcc69561a84d6fb1cf493146174ed: Status 404 returned error can't find the container with id 391ab920619e321155dafa73d8d47a81b8dfcc69561a84d6fb1cf493146174ed Jun 10 01:04:25.369717 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.369670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:25.468630 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.468592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:25.629018 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.628925 2565 generic.go:356] "Generic (PLEG): container finished" podID="e0ba70ae-0548-4863-bdb6-e94715a3c57d" containerID="cf2e1a0bd60e86d77f9bf4f9b1579b369567a5b5323747ab35cf2452dc79479b" exitCode=0 Jun 10 01:04:25.629181 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.629026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-km98j" event={"ID":"e0ba70ae-0548-4863-bdb6-e94715a3c57d","Type":"ContainerDied","Data":"cf2e1a0bd60e86d77f9bf4f9b1579b369567a5b5323747ab35cf2452dc79479b"} Jun 10 01:04:25.633997 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.632917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" event={"ID":"6645236f-5b1e-4b72-94ec-a60fa26d7002","Type":"ContainerStarted","Data":"8303bcf094c65df857242fc5dc3db584fcc193b2a9fcb498a0f1d1e80b1542fb"} Jun 10 01:04:25.633997 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.632979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" event={"ID":"6645236f-5b1e-4b72-94ec-a60fa26d7002","Type":"ContainerStarted","Data":"5b595460a31503f4527d366f1a0208050490ccaedff16a66bfa6779ab0b50656"} Jun 10 01:04:25.633997 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.633005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" event={"ID":"6645236f-5b1e-4b72-94ec-a60fa26d7002","Type":"ContainerStarted","Data":"e8e28cf1402852f910a7211102cc2c5b1f0c98b06394c3374ef5c706ec2d31ba"} Jun 10 01:04:25.635672 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.635646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"391ab920619e321155dafa73d8d47a81b8dfcc69561a84d6fb1cf493146174ed"} Jun 10 01:04:25.637077 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.637042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848688f45d-xgz99" event={"ID":"a2dc536d-5499-457e-aaab-55c10c0f24dc","Type":"ContainerStarted","Data":"afd07da6677c585bf8e96e32c7ff8e3db0105270091c9a376fd49639ddf9c71d"} Jun 10 01:04:25.670266 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.670207 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sj9w5" podStartSLOduration=1.986515991 podStartE2EDuration="3.670184621s" totalImagesPullingTime="1.68366863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:25.668818335 +0000 UTC m=+206.246169483" watchObservedRunningTime="2026-06-10 01:04:25.670184621 +0000 UTC m=+206.247535748" Jun 10 01:04:25.711576 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:25.711502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:26.643047 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:26.642991 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-km98j" event={"ID":"e0ba70ae-0548-4863-bdb6-e94715a3c57d","Type":"ContainerStarted","Data":"b710e814af9ea62557314710f331876e3ee201c2a8f7ca70b97859ada5b81632"} Jun 10 01:04:26.643488 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:26.643076 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-km98j" event={"ID":"e0ba70ae-0548-4863-bdb6-e94715a3c57d","Type":"ContainerStarted","Data":"0c5104762c7f396dc8a7559c0b1e3edb23ac2e6173950d8d161d3766b1ab352b"} Jun 10 01:04:26.663630 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:26.663569 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-km98j" podStartSLOduration=3.337213299 podStartE2EDuration="4.663547677s" totalImagesPullingTime="1.212479795s" totalInitContainerRuntime="113.854583ms" isStatefulPod=true podCreationTimestamp="2026-06-10 01:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:26.661440148 +0000 UTC m=+207.238791273" watchObservedRunningTime="2026-06-10 01:04:26.663547677 +0000 UTC m=+207.240898802" Jun 10 01:04:27.223252 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:27.223128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:27.276098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:27.276060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:27.608992 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:27.608896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:28.175361 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.175332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:28.275869 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.275840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:28.620436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.620398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:28.622978 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.622945 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:04:28.626892 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.626850 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.629839 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.629799 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 01:04:28.630089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630036 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 01:04:28.630089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 01:04:28.630089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 01:04:28.630283 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630040 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 01:04:28.630901 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630849 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 01:04:28.630901 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630857 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 01:04:28.631120 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.630902 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-62hqt1ls02s6v\"" Jun 10 01:04:28.631391 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.631367 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q8k76\"" Jun 10 01:04:28.631499 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.631473 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 01:04:28.631566 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.631499 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 01:04:28.637294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.633578 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 01:04:28.637294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.633839 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 01:04:28.637294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.634779 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 01:04:28.637294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.635019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 01:04:28.637294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.635248 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 01:04:28.638980 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.638955 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 01:04:28.642001 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.641968 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:04:28.654827 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.654791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848688f45d-xgz99" event={"ID":"a2dc536d-5499-457e-aaab-55c10c0f24dc","Type":"ContainerStarted","Data":"08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765"} Jun 10 01:04:28.657815 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.657787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"7a1303f4de6d07d2d11935c32fa6c96454bb90a5bf338a41a1bc4e54bea95259"} Jun 10 01:04:28.657994 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.657849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"42fd418282aa3685d2a8cde05e6926a21bc4673ab941073aca645543de5739b1"} Jun 10 01:04:28.657994 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.657900 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"9070067656ab7f5f121a6c564486a20285e339176712842d40ac3ac2061aaed6"} Jun 10 01:04:28.676302 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.676208 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848688f45d-xgz99" podStartSLOduration=2.275334011 podStartE2EDuration="5.676191325s" totalImagesPullingTime="3.400857314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:28.675208593 +0000 UTC m=+209.252559718" watchObservedRunningTime="2026-06-10 01:04:28.676191325 +0000 UTC m=+209.253542449" Jun 10 01:04:28.743859 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.743825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.743859 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.743863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.743896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.743918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.743939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744106 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config-out\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mgfr\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-kube-api-access-9mgfr\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744429 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-web-config\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744723 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744723 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.744723 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.744541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.845797 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.845691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.845837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.845897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.845931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.845954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.845984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-web-config\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config-out\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgfr\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-kube-api-access-9mgfr\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846847 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.846994 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.846965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.849392 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.848784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.849392 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.849184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.850169 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.850140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.851037 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.851014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.851212 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.851183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.851440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.851411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.851932 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.851910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.852031 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.852007 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.852807 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.852762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.853106 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.853084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.853627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.853596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-web-config\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.854615 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.854584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.855248 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.855199 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.855368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.855343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.855465 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.855409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.855525 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.855510 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.855677 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.855660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config-out\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.856231 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.856206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mgfr\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-kube-api-access-9mgfr\") pod \"prometheus-k8s-0\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:28.944587 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:28.944489 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:29.095120 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:29.095081 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:04:29.166464 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:04:29.166430 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fd9717_d0aa_472f_a8d2_d2a54dadc265.slice/crio-cb0a2233e04d570f27a12ab69bfa7cffe483d6147b201159b6c928f1ef8ade5f WatchSource:0}: Error finding container cb0a2233e04d570f27a12ab69bfa7cffe483d6147b201159b6c928f1ef8ade5f: Status 404 returned error can't find the container with id cb0a2233e04d570f27a12ab69bfa7cffe483d6147b201159b6c928f1ef8ade5f Jun 10 01:04:29.663472 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:29.663382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"cb0a2233e04d570f27a12ab69bfa7cffe483d6147b201159b6c928f1ef8ade5f"} Jun 10 01:04:29.666143 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:29.666117 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"c76f9efb17d72b3fd589e0510ee50d09dcaccad36e251ea16324c5204443fba8"} Jun 10 01:04:29.666250 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:29.666181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"5aefb148939a0e9abc86930deb6a3c165ef5e596a21b930596d5ebd1bdb0a547"} Jun 10 01:04:29.666250 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:29.666210 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" event={"ID":"760ff3d5-e577-43be-98de-0090c3da7ccd","Type":"ContainerStarted","Data":"b573c70a64be9bcc29b7d41e7d369840e11791d26db43a6f8c44e9adccb0b344"} Jun 10 01:04:29.685276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:29.685193 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" podStartSLOduration=1.602946106 podStartE2EDuration="5.68517927s" totalImagesPullingTime="4.082233164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:29.684916446 +0000 UTC m=+210.262267572" watchObservedRunningTime="2026-06-10 01:04:29.68517927 +0000 UTC m=+210.262530392" Jun 10 01:04:30.670921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:30.670866 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" exitCode=0 Jun 10 01:04:30.671404 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:30.670977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} Jun 10 01:04:30.671474 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:30.671432 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:34.138314 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:34.138272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:34.225209 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:34.225173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:34.293293 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:34.293252 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:34.293473 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:34.293311 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:04:34.294941 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:34.294910 2565 patch_prober.go:28] interesting pod/console-848688f45d-xgz99 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 10 01:04:34.295093 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:34.294980 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-848688f45d-xgz99" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 10 01:04:35.696067 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.696025 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} Jun 10 01:04:35.696436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.696096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} Jun 10 01:04:35.696436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.696124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} Jun 10 01:04:35.696436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.696148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} Jun 10 01:04:35.696436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.696174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} Jun 10 01:04:35.696436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.696197 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerStarted","Data":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} Jun 10 01:04:35.731972 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:35.731905 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.337786134 podStartE2EDuration="7.731859335s" totalImagesPullingTime="5.374067469s" totalInitContainerRuntime="20.005732ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:35.730411241 +0000 UTC m=+216.307762394" watchObservedRunningTime="2026-06-10 01:04:35.731859335 +0000 UTC m=+216.309210461" Jun 10 01:04:36.679825 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:36.679796 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-747cfdd66f-wldkz" Jun 10 01:04:38.945007 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:38.944965 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:04:39.215722 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:39.215676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:39.266171 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:39.266130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:44.294098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:44.294061 2565 patch_prober.go:28] interesting pod/console-848688f45d-xgz99 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 10 01:04:44.294533 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:44.294113 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-848688f45d-xgz99" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 10 01:04:46.429897 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:46.429837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:46.479455 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:46.479423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:54.294299 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:54.294238 2565 patch_prober.go:28] interesting pod/console-848688f45d-xgz99 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 10 01:04:54.294769 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:54.294326 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-848688f45d-xgz99" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 10 01:04:56.027228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:56.027190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:56.077763 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:56.077727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:58.767223 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:58.767182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:04:58.819109 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:04:58.819073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:04.298179 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:04.298145 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:05:04.301960 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:04.301933 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:05:04.444720 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:04.444677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:05.440316 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:05.440280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:06.062979 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:06.062941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:06.109102 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:06.109059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:06.735726 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:06.735691 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-smddc_f748de4b-16f7-4253-9d1a-010c3341ad3d/cluster-monitoring-operator/0.log" Jun 10 01:05:06.933986 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:06.933959 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sj9w5_6645236f-5b1e-4b72-94ec-a60fa26d7002/kube-state-metrics/0.log" Jun 10 01:05:07.012720 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:07.012629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:07.134672 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:07.134636 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sj9w5_6645236f-5b1e-4b72-94ec-a60fa26d7002/kube-rbac-proxy-main/0.log" Jun 10 01:05:07.332910 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:07.332813 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sj9w5_6645236f-5b1e-4b72-94ec-a60fa26d7002/kube-rbac-proxy-self/0.log" Jun 10 01:05:08.532901 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:08.532853 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-km98j_e0ba70ae-0548-4863-bdb6-e94715a3c57d/init-textfile/0.log" Jun 10 01:05:08.733763 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:08.733727 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-km98j_e0ba70ae-0548-4863-bdb6-e94715a3c57d/node-exporter/0.log" Jun 10 01:05:08.932570 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:08.932482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-km98j_e0ba70ae-0548-4863-bdb6-e94715a3c57d/kube-rbac-proxy/0.log" Jun 10 01:05:08.982860 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:08.982824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:09.039453 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:09.039421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:10.333763 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.333719 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/init-config-reloader/0.log" Jun 10 01:05:10.534274 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.534242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/prometheus/0.log" Jun 10 01:05:10.642337 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.642257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:05:10.644610 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.644576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b69a9f4-8620-4a7c-adaa-4a20f0e6c675-metrics-certs\") pod \"network-metrics-daemon-t9m95\" (UID: \"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675\") " pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:05:10.750089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.750050 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/config-reloader/0.log" Jun 10 01:05:10.774753 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.774723 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qp5n8\"" Jun 10 01:05:10.782733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.782697 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9m95" Jun 10 01:05:10.917696 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.917616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t9m95"] Jun 10 01:05:10.920551 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:05:10.920524 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b69a9f4_8620_4a7c_adaa_4a20f0e6c675.slice/crio-28ac66965a9a35218a5f574200a33d7f42a2360ea5745f8885fac3fbdb9d8e2c WatchSource:0}: Error finding container 28ac66965a9a35218a5f574200a33d7f42a2360ea5745f8885fac3fbdb9d8e2c: Status 404 returned error can't find the container with id 28ac66965a9a35218a5f574200a33d7f42a2360ea5745f8885fac3fbdb9d8e2c Jun 10 01:05:10.933087 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:10.933060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/thanos-sidecar/0.log" Jun 10 01:05:11.132618 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:11.132591 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/kube-rbac-proxy-web/0.log" Jun 10 01:05:11.332849 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:11.332811 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/kube-rbac-proxy/0.log" Jun 10 01:05:11.533380 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:11.533352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11fd9717-d0aa-472f-a8d2-d2a54dadc265/kube-rbac-proxy-thanos/0.log" Jun 10 01:05:11.735260 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:11.735227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-qkrbg_a035ed0f-ed46-4578-a73c-405a2072144e/prometheus-operator/0.log" Jun 10 01:05:11.831677 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:11.831643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t9m95" event={"ID":"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675","Type":"ContainerStarted","Data":"28ac66965a9a35218a5f574200a33d7f42a2360ea5745f8885fac3fbdb9d8e2c"} Jun 10 01:05:11.933445 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:11.933413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-qkrbg_a035ed0f-ed46-4578-a73c-405a2072144e/kube-rbac-proxy/0.log" Jun 10 01:05:12.188182 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.188106 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848688f45d-xgz99"] Jun 10 01:05:12.291289 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.291257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:12.333011 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.332973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/thanos-query/0.log" Jun 10 01:05:12.392661 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.392627 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:12.491711 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.491676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:12.533476 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.533443 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy-web/0.log" Jun 10 01:05:12.733134 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.733102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy/0.log" Jun 10 01:05:12.837442 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.837343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t9m95" event={"ID":"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675","Type":"ContainerStarted","Data":"4b9efb4154b951c6a08beafbef3a09d1939cba6503b5c84289b5e7df8c6573c7"} Jun 10 01:05:12.837616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.837445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t9m95" event={"ID":"5b69a9f4-8620-4a7c-adaa-4a20f0e6c675","Type":"ContainerStarted","Data":"a07c17046c4ee9e1e6f6800640fb9caddf9869e7ea9f0f32a2f3ea8f581aee91"} Jun 10 01:05:12.854442 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.854380 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t9m95" podStartSLOduration=251.566518027 podStartE2EDuration="4m12.854364946s" totalImagesPullingTime="1.287846919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:12.853602485 +0000 UTC m=+253.430953635" watchObservedRunningTime="2026-06-10 01:05:12.854364946 +0000 UTC m=+253.431716071" Jun 10 01:05:12.932951 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.932910 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/prom-label-proxy/0.log" Jun 10 01:05:12.943110 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:12.943072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:13.043809 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:13.043772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:13.132902 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:13.132800 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy-rules/0.log" Jun 10 01:05:13.333526 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:13.333495 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy-metrics/0.log" Jun 10 01:05:13.533457 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:13.533420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-cwtdn_e3430e8f-1d03-4c64-a3db-5ec21899c9d2/networking-console-plugin/0.log" Jun 10 01:05:13.732738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:13.732712 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:05:13.935852 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:13.935774 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/2.log" Jun 10 01:05:14.134198 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:14.134120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-848688f45d-xgz99_a2dc536d-5499-457e-aaab-55c10c0f24dc/console/0.log" Jun 10 01:05:14.301034 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:14.300998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:14.402508 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:14.402474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:14.539934 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:14.539903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:14.641060 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:14.640954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:15.933543 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:15.933506 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54cm8_2d1e069d-e288-4697-8f70-6213cef84bf5/dns-node-resolver/0.log" Jun 10 01:05:16.933609 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:16.933572 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ljgg_b34d5e2e-4115-4802-8f98-8914e2b01e12/node-ca/0.log" Jun 10 01:05:17.534512 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:17.534478 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-674d5448f-c27fw_25baebd5-131e-4414-902f-1582b10ca57f/router/0.log" Jun 10 01:05:17.732724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:17.732699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hh2q_7f152419-a11c-4256-9ecc-778174e1b31c/serve-healthcheck-canary/0.log" Jun 10 01:05:18.061523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:18.061488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:18.160463 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:18.160429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:21.752156 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:21.752103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:21.853316 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:21.853281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:22.311808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:22.311760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:22.365070 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:22.365034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:28.769013 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:28.768957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:28.815333 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:28.815288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:28.944643 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:28.944617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:28.961245 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:28.961212 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:29.924070 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:29.924039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:37.221019 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.220977 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-848688f45d-xgz99" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" containerID="cri-o://08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765" gracePeriod=15 Jun 10 01:05:37.464331 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.464294 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:05:37.585631 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585526 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-service-ca\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.585631 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585568 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gkbs\" (UniqueName: \"kubernetes.io/projected/a2dc536d-5499-457e-aaab-55c10c0f24dc-kube-api-access-9gkbs\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.585631 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-oauth-serving-cert\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.585631 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585622 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-config\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.585989 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585647 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-serving-cert\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.585989 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585664 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-trusted-ca-bundle\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.585989 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.585696 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-oauth-config\") pod \"a2dc536d-5499-457e-aaab-55c10c0f24dc\" (UID: \"a2dc536d-5499-457e-aaab-55c10c0f24dc\") " Jun 10 01:05:37.586137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.586083 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:37.586137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.586089 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-config" (OuterVolumeSpecName: "console-config") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:37.586240 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.586181 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:37.586240 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.586207 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:37.588087 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.588058 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2dc536d-5499-457e-aaab-55c10c0f24dc-kube-api-access-9gkbs" (OuterVolumeSpecName: "kube-api-access-9gkbs") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "kube-api-access-9gkbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:05:37.588196 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.588120 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:37.588196 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.588139 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2dc536d-5499-457e-aaab-55c10c0f24dc" (UID: "a2dc536d-5499-457e-aaab-55c10c0f24dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:37.686494 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686448 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-oauth-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.686494 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686486 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-service-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.686494 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686502 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gkbs\" (UniqueName: \"kubernetes.io/projected/a2dc536d-5499-457e-aaab-55c10c0f24dc-kube-api-access-9gkbs\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.686732 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686514 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-oauth-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.686732 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686525 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.686732 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686537 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2dc536d-5499-457e-aaab-55c10c0f24dc-console-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.686732 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.686547 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2dc536d-5499-457e-aaab-55c10c0f24dc-trusted-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:37.937959 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.937919 2565 generic.go:356] "Generic (PLEG): container finished" podID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerID="08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765" exitCode=0 Jun 10 01:05:37.938118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.937964 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848688f45d-xgz99" Jun 10 01:05:37.938118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.937989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848688f45d-xgz99" event={"ID":"a2dc536d-5499-457e-aaab-55c10c0f24dc","Type":"ContainerDied","Data":"08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765"} Jun 10 01:05:37.938118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.938036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848688f45d-xgz99" event={"ID":"a2dc536d-5499-457e-aaab-55c10c0f24dc","Type":"ContainerDied","Data":"afd07da6677c585bf8e96e32c7ff8e3db0105270091c9a376fd49639ddf9c71d"} Jun 10 01:05:37.938118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.938058 2565 scope.go:117] "RemoveContainer" containerID="08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765" Jun 10 01:05:37.949203 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.949178 2565 scope.go:117] "RemoveContainer" containerID="08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765" Jun 10 01:05:37.949504 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:37.949484 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765\": container with ID starting with 08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765 not found: ID does not exist" containerID="08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765" Jun 10 01:05:37.949568 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.949512 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765"} err="failed to get container status \"08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765\": rpc error: code = NotFound desc = could not find container \"08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765\": container with ID starting with 08bafba3ffea42e005a9f9af557cf4670bb0fd7bb416245292d62f53a1b25765 not found: ID does not exist" Jun 10 01:05:37.956156 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.956125 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848688f45d-xgz99"] Jun 10 01:05:37.957359 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:37.957337 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-848688f45d-xgz99"] Jun 10 01:05:39.876702 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:39.876663 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" path="/var/lib/kubelet/pods/a2dc536d-5499-457e-aaab-55c10c0f24dc/volumes" Jun 10 01:05:40.451399 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:40.451360 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfddt" podUID="2caca382-1d26-40ad-91ec-515564f2319c" Jun 10 01:05:40.949730 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:40.949685 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfddt" Jun 10 01:05:41.614185 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:41.614150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:41.815565 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:41.815524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:42.605646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:42.605605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:42.676605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:42.676575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:43.763514 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:43.763478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:43.815984 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:43.815948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:44.345117 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:44.345078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:05:44.347604 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:44.347576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2caca382-1d26-40ad-91ec-515564f2319c-metrics-tls\") pod \"dns-default-hfddt\" (UID: \"2caca382-1d26-40ad-91ec-515564f2319c\") " pod="openshift-dns/dns-default-hfddt" Jun 10 01:05:44.552975 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:44.552944 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vqpqf\"" Jun 10 01:05:44.561072 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:44.561053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfddt" Jun 10 01:05:44.690196 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:44.690147 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfddt"] Jun 10 01:05:44.692506 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:05:44.692471 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2caca382_1d26_40ad_91ec_515564f2319c.slice/crio-158248a3fdf6379d1a756020b60ff5c34d2b80456e347756b367e19d96fb88ea WatchSource:0}: Error finding container 158248a3fdf6379d1a756020b60ff5c34d2b80456e347756b367e19d96fb88ea: Status 404 returned error can't find the container with id 158248a3fdf6379d1a756020b60ff5c34d2b80456e347756b367e19d96fb88ea Jun 10 01:05:44.965732 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:44.965694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfddt" event={"ID":"2caca382-1d26-40ad-91ec-515564f2319c","Type":"ContainerStarted","Data":"158248a3fdf6379d1a756020b60ff5c34d2b80456e347756b367e19d96fb88ea"} Jun 10 01:05:45.948024 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:45.947986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:46.049485 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:46.049401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:46.104058 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:46.104015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:46.978632 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:46.978532 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfddt" event={"ID":"2caca382-1d26-40ad-91ec-515564f2319c","Type":"ContainerStarted","Data":"d48042e148b3648b79df996a4226113f2d5beb8545133ab3f0e0cda02f6484a8"} Jun 10 01:05:47.063931 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.063893 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:05:47.064381 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.064281 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="prometheus" containerID="cri-o://993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" gracePeriod=600 Jun 10 01:05:47.065030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.064549 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy" containerID="cri-o://ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" gracePeriod=600 Jun 10 01:05:47.065030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.064662 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-web" containerID="cri-o://b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" gracePeriod=600 Jun 10 01:05:47.065030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.064736 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-thanos" containerID="cri-o://022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" gracePeriod=600 Jun 10 01:05:47.065030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.064764 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="thanos-sidecar" containerID="cri-o://192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" gracePeriod=600 Jun 10 01:05:47.065030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.064866 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="config-reloader" containerID="cri-o://ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" gracePeriod=600 Jun 10 01:05:47.505592 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.505565 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:47.685132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685050 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-db\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685103 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-serving-certs-ca-bundle\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685129 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-thanos-prometheus-http-client-file\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685397 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685153 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685397 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685178 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-trusted-ca-bundle\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685397 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685348 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-metrics-client-certs\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685551 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685414 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-kubelet-serving-ca-bundle\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685551 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685476 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685551 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685514 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-grpc-tls\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685551 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685518 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.685733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685553 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config-out\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685578 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.685733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685588 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mgfr\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-kube-api-access-9mgfr\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685651 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-0\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685764 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-metrics-client-ca\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685817 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-1\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685843 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-tls\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685871 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-web-config\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.685965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685932 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-2\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.686185 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.685963 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.686185 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.686013 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-tls-assets\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.686185 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.686047 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-kube-rbac-proxy\") pod \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\" (UID: \"11fd9717-d0aa-472f-a8d2-d2a54dadc265\") " Jun 10 01:05:47.686333 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.686275 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.686453 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.686401 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:05:47.687257 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.687227 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.687615 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.687583 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.687725 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.687705 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.688583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688120 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:47.688583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688381 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.688729 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688672 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-db\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688729 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688696 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688729 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688712 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688729 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688746 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688760 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688776 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-configmap-metrics-client-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688792 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.688870 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688806 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11fd9717-d0aa-472f-a8d2-d2a54dadc265-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.689376 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.688865 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.689437 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.689392 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.690128 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.690103 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.690252 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.690233 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.691253 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.691227 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:05:47.691253 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.691241 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-kube-api-access-9mgfr" (OuterVolumeSpecName: "kube-api-access-9mgfr") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "kube-api-access-9mgfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:05:47.691557 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.691530 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config-out" (OuterVolumeSpecName: "config-out") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:05:47.691557 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.691539 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.691945 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.691924 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.691998 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.691950 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config" (OuterVolumeSpecName: "config") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.701907 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.701865 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-web-config" (OuterVolumeSpecName: "web-config") pod "11fd9717-d0aa-472f-a8d2-d2a54dadc265" (UID: "11fd9717-d0aa-472f-a8d2-d2a54dadc265"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:47.789926 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789857 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.789926 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789916 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-web-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.789926 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789926 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.789926 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789935 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-tls-assets\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.789926 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789943 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-kube-rbac-proxy\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.790218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789952 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.790218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789962 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-metrics-client-certs\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.790218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789972 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.790218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789980 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11fd9717-d0aa-472f-a8d2-d2a54dadc265-secret-grpc-tls\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.790218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789988 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11fd9717-d0aa-472f-a8d2-d2a54dadc265-config-out\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.790218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.789995 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mgfr\" (UniqueName: \"kubernetes.io/projected/11fd9717-d0aa-472f-a8d2-d2a54dadc265-kube-api-access-9mgfr\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:05:47.989190 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.989153 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfddt" event={"ID":"2caca382-1d26-40ad-91ec-515564f2319c","Type":"ContainerStarted","Data":"716fcf82c38e2ecd8dd1e9ed4218e91d8f143d1c57c79edb95d2c0f7a0b7a16a"} Jun 10 01:05:47.989391 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.989330 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hfddt" Jun 10 01:05:47.992182 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992152 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" exitCode=0 Jun 10 01:05:47.992182 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992181 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" exitCode=0 Jun 10 01:05:47.992182 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992190 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" exitCode=0 Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992202 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" exitCode=0 Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992211 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" exitCode=0 Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992218 2565 generic.go:356] "Generic (PLEG): container finished" podID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" exitCode=0 Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992234 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992271 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} Jun 10 01:05:47.992431 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992410 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:47.992842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} Jun 10 01:05:47.992842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992515 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} Jun 10 01:05:47.992842 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:47.992557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11fd9717-d0aa-472f-a8d2-d2a54dadc265","Type":"ContainerDied","Data":"cb0a2233e04d570f27a12ab69bfa7cffe483d6147b201159b6c928f1ef8ade5f"} Jun 10 01:05:48.000288 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.000266 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.006771 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.006715 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hfddt" podStartSLOduration=251.87143988 podStartE2EDuration="4m14.006697186s" totalImagesPullingTime="2.135257306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:48.005185823 +0000 UTC m=+288.582536977" watchObservedRunningTime="2026-06-10 01:05:48.006697186 +0000 UTC m=+288.584048313" Jun 10 01:05:48.008871 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.008851 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.016320 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.016299 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.019731 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.019708 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:05:48.024750 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.024697 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:05:48.026721 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.026701 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.034650 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.034632 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.042478 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.042460 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.048273 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048251 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:05:48.048536 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048524 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="init-config-reloader" Jun 10 01:05:48.048583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048539 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="init-config-reloader" Jun 10 01:05:48.048583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048552 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-thanos" Jun 10 01:05:48.048583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048561 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-thanos" Jun 10 01:05:48.048583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048571 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="prometheus" Jun 10 01:05:48.048583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048576 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="prometheus" Jun 10 01:05:48.048583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048585 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="thanos-sidecar" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048590 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="thanos-sidecar" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048596 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048601 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048607 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="config-reloader" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048612 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="config-reloader" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048621 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-web" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048626 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-web" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048634 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048639 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048681 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-web" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048687 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="thanos-sidecar" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048693 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="prometheus" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048699 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048706 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2dc536d-5499-457e-aaab-55c10c0f24dc" containerName="console" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048712 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="kube-rbac-proxy-thanos" Jun 10 01:05:48.048748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.048717 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" containerName="config-reloader" Jun 10 01:05:48.049921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.049891 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.050253 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.050228 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.050403 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.050262 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} err="failed to get container status \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" Jun 10 01:05:48.050403 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.050286 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.050599 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.050578 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.050665 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.050609 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} err="failed to get container status \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" Jun 10 01:05:48.050665 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.050633 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.050934 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.050910 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.050992 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.050942 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} err="failed to get container status \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" Jun 10 01:05:48.050992 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.050960 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.051260 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.051240 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.051347 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.051264 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} err="failed to get container status \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" Jun 10 01:05:48.051347 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.051281 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.051808 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.051764 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.051908 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.051816 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} err="failed to get container status \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" Jun 10 01:05:48.051908 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.051839 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.052141 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.052206 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.052139 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.052206 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052158 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} err="failed to get container status \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" Jun 10 01:05:48.052206 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052171 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.052653 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:05:48.052451 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.052653 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052490 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} err="failed to get container status \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" Jun 10 01:05:48.052653 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052514 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.052836 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052761 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} err="failed to get container status \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" Jun 10 01:05:48.052836 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.052786 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.053089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053061 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} err="failed to get container status \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" Jun 10 01:05:48.053089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053088 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.053355 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053332 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} err="failed to get container status \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" Jun 10 01:05:48.053413 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053360 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.053597 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053578 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} err="failed to get container status \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" Jun 10 01:05:48.053644 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053597 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.053832 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053816 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} err="failed to get container status \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" Jun 10 01:05:48.053832 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.053832 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.054079 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054063 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} err="failed to get container status \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" Jun 10 01:05:48.054135 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054080 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.054351 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054327 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} err="failed to get container status \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" Jun 10 01:05:48.054351 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054350 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.054585 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054566 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 01:05:48.054691 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 01:05:48.054691 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054671 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-62hqt1ls02s6v\"" Jun 10 01:05:48.054847 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054669 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} err="failed to get container status \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" Jun 10 01:05:48.054847 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054767 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.054993 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054849 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 01:05:48.054993 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054984 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 01:05:48.055105 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.054986 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 01:05:48.055105 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055023 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 01:05:48.055209 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055135 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 01:05:48.055209 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055171 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} err="failed to get container status \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" Jun 10 01:05:48.055209 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055197 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.055350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055238 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 01:05:48.055350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055254 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 01:05:48.055350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055241 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q8k76\"" Jun 10 01:05:48.055350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 01:05:48.055350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055340 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 01:05:48.055584 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055395 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 01:05:48.055584 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055444 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} err="failed to get container status \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" Jun 10 01:05:48.055584 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055469 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.055584 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055562 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 01:05:48.055808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055728 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} err="failed to get container status \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" Jun 10 01:05:48.055808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055748 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.056017 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.055994 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} err="failed to get container status \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" Jun 10 01:05:48.056092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.056020 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.056304 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.056280 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} err="failed to get container status \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" Jun 10 01:05:48.056377 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.056306 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.056630 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.056601 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} err="failed to get container status \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" Jun 10 01:05:48.056712 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.056631 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.057045 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057017 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} err="failed to get container status \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" Jun 10 01:05:48.057120 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057046 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.057388 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057359 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} err="failed to get container status \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" Jun 10 01:05:48.057492 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057408 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.057760 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057696 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} err="failed to get container status \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" Jun 10 01:05:48.057760 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057724 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.058012 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.057991 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} err="failed to get container status \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" Jun 10 01:05:48.058012 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.058012 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.058401 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.058374 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} err="failed to get container status \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" Jun 10 01:05:48.058463 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.058403 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.058712 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.058684 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} err="failed to get container status \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" Jun 10 01:05:48.058791 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.058713 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.058791 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.058763 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 01:05:48.059222 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.059198 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} err="failed to get container status \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" Jun 10 01:05:48.059222 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.059225 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.059503 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.059481 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} err="failed to get container status \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" Jun 10 01:05:48.059568 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.059505 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.059788 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.059767 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} err="failed to get container status \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" Jun 10 01:05:48.059841 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.059791 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.060065 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060043 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} err="failed to get container status \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" Jun 10 01:05:48.060129 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060068 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.060626 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060355 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} err="failed to get container status \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" Jun 10 01:05:48.060626 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060377 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 01:05:48.060626 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060381 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.060793 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060689 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} err="failed to get container status \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" Jun 10 01:05:48.060793 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.060706 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.061084 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061066 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} err="failed to get container status \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" Jun 10 01:05:48.061130 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061084 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.061315 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061291 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} err="failed to get container status \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" Jun 10 01:05:48.061378 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061315 2565 scope.go:117] "RemoveContainer" containerID="022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472" Jun 10 01:05:48.061545 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061526 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472"} err="failed to get container status \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": rpc error: code = NotFound desc = could not find container \"022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472\": container with ID starting with 022303d710aa44b3d4a582b2718636e7d4acc052bab2699a527d6ce8ac278472 not found: ID does not exist" Jun 10 01:05:48.061600 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061545 2565 scope.go:117] "RemoveContainer" containerID="ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca" Jun 10 01:05:48.061759 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061740 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca"} err="failed to get container status \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": rpc error: code = NotFound desc = could not find container \"ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca\": container with ID starting with ed89388b17b25db67bf13a0bb74a0b5fd11c13e1bd74378394c09ee1e49499ca not found: ID does not exist" Jun 10 01:05:48.061835 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.061761 2565 scope.go:117] "RemoveContainer" containerID="b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6" Jun 10 01:05:48.062027 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062006 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6"} err="failed to get container status \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": rpc error: code = NotFound desc = could not find container \"b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6\": container with ID starting with b30b184f549389163b0c7d56b937613e01e2c96b9965fa194dc25ca7d8f411c6 not found: ID does not exist" Jun 10 01:05:48.062107 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062027 2565 scope.go:117] "RemoveContainer" containerID="192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1" Jun 10 01:05:48.062220 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062202 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1"} err="failed to get container status \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": rpc error: code = NotFound desc = could not find container \"192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1\": container with ID starting with 192ed39ba5aa1b77f47ffee508c4f8a40d076ad9bed2fb2eba399e6bd1aff2a1 not found: ID does not exist" Jun 10 01:05:48.062285 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062220 2565 scope.go:117] "RemoveContainer" containerID="ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596" Jun 10 01:05:48.062451 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062433 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596"} err="failed to get container status \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": rpc error: code = NotFound desc = could not find container \"ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596\": container with ID starting with ac502e1991574d1aa381af1ce2805fcd567451fdfbc58dc42986287cad47d596 not found: ID does not exist" Jun 10 01:05:48.062451 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062450 2565 scope.go:117] "RemoveContainer" containerID="993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade" Jun 10 01:05:48.062677 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062655 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade"} err="failed to get container status \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": rpc error: code = NotFound desc = could not find container \"993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade\": container with ID starting with 993b06919285b96b630e3ebc90c0974931543ec58b4f3f005c9cb3ce7f837ade not found: ID does not exist" Jun 10 01:05:48.062745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062677 2565 scope.go:117] "RemoveContainer" containerID="f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e" Jun 10 01:05:48.062933 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.062914 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e"} err="failed to get container status \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": rpc error: code = NotFound desc = could not find container \"f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e\": container with ID starting with f94aa231b458263946eaf65f89e501204b8fceb9cc8cf7d7a279417d2835478e not found: ID does not exist" Jun 10 01:05:48.068905 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.068849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:05:48.192176 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192356 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-config\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192356 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192356 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192356 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2llkx\" (UniqueName: \"kubernetes.io/projected/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-kube-api-access-2llkx\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192356 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192356 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.192745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.192737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-config\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2llkx\" (UniqueName: \"kubernetes.io/projected/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-kube-api-access-2llkx\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.293605 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.293435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294300 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294405 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294405 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294523 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294909 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294909 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294909 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.294909 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.294676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.295246 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.295219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.295576 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.295545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.297952 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.297466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.297952 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.297575 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.297952 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.297809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.297952 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.297854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.298194 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.298194 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-config\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.298446 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.298529 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.298715 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.298792 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298743 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.299030 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.298995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.299141 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.299069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.299254 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.299236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.299745 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.299722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.299981 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.299956 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.301130 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.301109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.302200 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.302179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2llkx\" (UniqueName: \"kubernetes.io/projected/dea3c0a6-7e89-4f7f-b225-7fb353cef0a4-kube-api-access-2llkx\") pod \"prometheus-k8s-0\" (UID: \"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.363818 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.363779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:48.502331 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.502304 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:05:48.504465 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:05:48.504442 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea3c0a6_7e89_4f7f_b225_7fb353cef0a4.slice/crio-a346cf6f3a7ec064da4022740fd8b55222ced4bcc048c2ddbc34a21f68bffdca WatchSource:0}: Error finding container a346cf6f3a7ec064da4022740fd8b55222ced4bcc048c2ddbc34a21f68bffdca: Status 404 returned error can't find the container with id a346cf6f3a7ec064da4022740fd8b55222ced4bcc048c2ddbc34a21f68bffdca Jun 10 01:05:48.997802 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.997767 2565 generic.go:356] "Generic (PLEG): container finished" podID="dea3c0a6-7e89-4f7f-b225-7fb353cef0a4" containerID="178d160c3416922f5d42ff3a82472941daa5ff595657ebf80528548268e7ed69" exitCode=0 Jun 10 01:05:48.998014 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.997863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerDied","Data":"178d160c3416922f5d42ff3a82472941daa5ff595657ebf80528548268e7ed69"} Jun 10 01:05:48.998014 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:48.997961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"a346cf6f3a7ec064da4022740fd8b55222ced4bcc048c2ddbc34a21f68bffdca"} Jun 10 01:05:49.881203 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:49.879189 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11fd9717-d0aa-472f-a8d2-d2a54dadc265" path="/var/lib/kubelet/pods/11fd9717-d0aa-472f-a8d2-d2a54dadc265/volumes" Jun 10 01:05:50.004780 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.004742 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"388157486d18f86aa43ed2afceee48ebeb7b3144f3725b75390a289d93798885"} Jun 10 01:05:50.004964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.004807 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"8467e6a0306173c56440b331b98ed85b1175ca06b624c473bd4aae2dd9c6d726"} Jun 10 01:05:50.004964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.004835 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"ea5f5e66e7a4d62a8fe805952a3dbff929d0b546ebdcaedc4ffb9ce87f110c4e"} Jun 10 01:05:50.004964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.004858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"11e7a67df538a70385ef839cde3460008992e58be1033cfbf4cbd6447802c1b0"} Jun 10 01:05:50.004964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.004902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"94152f6f7282f328ee89810fcc822263980f869306002227c6eadf964368cb87"} Jun 10 01:05:50.004964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.004928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dea3c0a6-7e89-4f7f-b225-7fb353cef0a4","Type":"ContainerStarted","Data":"fa138cac77929a003ce45b6f1ac26c786de39db57250c1c8615f7d964252cec8"} Jun 10 01:05:50.035011 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:50.034946 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.015504837 podStartE2EDuration="2.034927678s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.422841ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:50.032751564 +0000 UTC m=+290.610102709" watchObservedRunningTime="2026-06-10 01:05:50.034927678 +0000 UTC m=+290.612278799" Jun 10 01:05:51.197056 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:51.197014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:51.252896 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:51.252835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:51.341330 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:51.341295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:51.388218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:51.388181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:51.946239 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:51.946199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:51.998348 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:51.998309 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:53.364056 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:53.364006 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:05:58.000206 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:58.000171 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hfddt" Jun 10 01:05:58.777155 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:58.777119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:58.836824 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:58.836786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:59.823968 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:59.823938 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:05:59.824919 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:59.824867 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:05:59.834154 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:05:59.834134 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 01:06:02.610510 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:02.610467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:02.663116 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:02.663076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:02.716895 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:02.716836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:07.116799 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:07.116762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:33.352253 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:33.352214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:33.399742 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:33.399701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:37.183953 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:37.183917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:48.364247 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:48.364199 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:48.380464 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:48.380436 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:49.251134 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:49.251100 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:56.877702 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:56.877663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:06:56.945545 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:06:56.945512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:08.646615 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:08.646569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:08.723697 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:08.723665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:08.781649 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:08.781612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:13.773865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:13.773824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:13.871830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:13.871790 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:13.972887 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:13.972845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:19.926081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:19.926040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:19.975672 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:19.975635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:20.029514 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:20.029485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:20.088596 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:20.088556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:35.035965 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:35.035922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:07:35.133712 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:07:35.133676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:01.033400 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:01.033350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:06.616450 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:06.616401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:07.394411 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:07.394376 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:10.228005 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:10.227961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:10.529648 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:10.529556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:12.336121 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:12.336082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:12.428616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:12.428580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:12.532571 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:12.532531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:15.785052 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:15.784947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:16.205756 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:16.205709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:17.207447 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:17.207408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:17.263982 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:17.263942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:17.671539 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:17.671463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:20.899344 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:20.899303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:20.992633 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:20.992599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:23.978968 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:23.978921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:34.932567 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:34.932530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:35.035053 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:35.035002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:41.919723 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:41.919687 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:42.023046 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:42.023009 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:43.848867 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:43.848834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:48.063126 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.063087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:48.127808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.127765 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd"] Jun 10 01:08:48.131157 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.131127 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.134368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.134334 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:08:48.135664 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.135641 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xz7ws\"" Jun 10 01:08:48.135792 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.135771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 01:08:48.135861 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.135681 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 01:08:48.135949 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.135805 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 01:08:48.135949 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.135673 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 01:08:48.153396 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.153371 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd"] Jun 10 01:08:48.180916 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.180866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:48.225130 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.225098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-cert\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.225130 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.225140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqrgh\" (UniqueName: \"kubernetes.io/projected/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-kube-api-access-sqrgh\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.225355 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.225179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-manager-config\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.225355 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.225275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-metrics-cert\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.325705 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.325622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-cert\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.325705 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.325657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrgh\" (UniqueName: \"kubernetes.io/projected/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-kube-api-access-sqrgh\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.325705 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.325683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-manager-config\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.325975 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.325718 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-metrics-cert\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.326436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.326412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-manager-config\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.328468 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.328437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-cert\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.328558 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.328437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-metrics-cert\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.343640 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.343605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqrgh\" (UniqueName: \"kubernetes.io/projected/23c09c4a-daad-45b0-9ab9-d0f8dedfab0d-kube-api-access-sqrgh\") pod \"lws-controller-manager-dcf7bd6dd-qwdjd\" (UID: \"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.440776 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.440728 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:48.581447 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.581286 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd"] Jun 10 01:08:48.584153 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:08:48.584114 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c09c4a_daad_45b0_9ab9_d0f8dedfab0d.slice/crio-2855f0bb406a8e5abdfd20785d4aee2e843ac18db05f7306357b58fe1b99a687 WatchSource:0}: Error finding container 2855f0bb406a8e5abdfd20785d4aee2e843ac18db05f7306357b58fe1b99a687: Status 404 returned error can't find the container with id 2855f0bb406a8e5abdfd20785d4aee2e843ac18db05f7306357b58fe1b99a687 Jun 10 01:08:48.586056 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.586039 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:08:48.690411 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:48.690375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" event={"ID":"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d","Type":"ContainerStarted","Data":"2855f0bb406a8e5abdfd20785d4aee2e843ac18db05f7306357b58fe1b99a687"} Jun 10 01:08:51.704308 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:51.704273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" event={"ID":"23c09c4a-daad-45b0-9ab9-d0f8dedfab0d","Type":"ContainerStarted","Data":"8c7c251d4387d8675f312265c2c659536f98e818c64619df5ad567dc31788b12"} Jun 10 01:08:51.704686 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:51.704383 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:08:51.718419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:51.718303 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" podStartSLOduration=1.2562978870000001 podStartE2EDuration="3.718283308s" totalImagesPullingTime="2.461985421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:51.718030685 +0000 UTC m=+472.295381837" watchObservedRunningTime="2026-06-10 01:08:51.718283308 +0000 UTC m=+472.295634434" Jun 10 01:08:56.087612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:56.087561 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:56.186156 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:56.186121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:56.709738 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:56.709691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:56.978929 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:56.978823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.077732 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.077695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.118888 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.118852 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4"] Jun 10 01:08:57.122421 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.122395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.126346 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.126322 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 01:08:57.126460 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.126357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hm9zf\"" Jun 10 01:08:57.126631 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.126617 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 01:08:57.126859 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.126846 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 01:08:57.127071 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.127054 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 01:08:57.139871 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.139838 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4"] Jun 10 01:08:57.200138 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.200101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-manifests\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.200337 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.200171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.200337 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.200209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5764b\" (UniqueName: \"kubernetes.io/projected/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-kube-api-access-5764b\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.200337 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.200235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-tmp\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.200470 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.200326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.233252 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.233158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.301168 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.301130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-manifests\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.301371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.301185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.301371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.301209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5764b\" (UniqueName: \"kubernetes.io/projected/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-kube-api-access-5764b\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.301371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.301242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-tmp\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.301371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.301268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.301650 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.301611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-manifests\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.303654 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.303616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-tmp\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.304411 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.304390 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.304521 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.304429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.309138 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.309113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5764b\" (UniqueName: \"kubernetes.io/projected/c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5-kube-api-access-5764b\") pod \"opendatahub-operator-controller-manager-858fd5d86-g26z4\" (UID: \"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.332363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.332332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.432770 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.432731 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:08:57.433536 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.433510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.534216 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.534181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.573156 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.573126 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4"] Jun 10 01:08:57.576495 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:08:57.576469 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ac6ef1_b799_4a69_ac0a_2d39c2209eb5.slice/crio-425a0e2f9eb84dff9ffded8de02cb27d67c149cec713bfc2fe97cf1bf3401a00 WatchSource:0}: Error finding container 425a0e2f9eb84dff9ffded8de02cb27d67c149cec713bfc2fe97cf1bf3401a00: Status 404 returned error can't find the container with id 425a0e2f9eb84dff9ffded8de02cb27d67c149cec713bfc2fe97cf1bf3401a00 Jun 10 01:08:57.644228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.644173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:08:57.732098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:08:57.731953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" event={"ID":"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5","Type":"ContainerStarted","Data":"425a0e2f9eb84dff9ffded8de02cb27d67c149cec713bfc2fe97cf1bf3401a00"} Jun 10 01:09:01.750638 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:01.750603 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" event={"ID":"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5","Type":"ContainerStarted","Data":"4ee0c460d4b3d560941b955af05a49b91d1e7a331206b33132a7967b82d3ee22"} Jun 10 01:09:02.710406 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:02.710374 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qwdjd" Jun 10 01:09:02.757050 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:02.757015 2565 generic.go:356] "Generic (PLEG): container finished" podID="c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5" containerID="4ee0c460d4b3d560941b955af05a49b91d1e7a331206b33132a7967b82d3ee22" exitCode=0 Jun 10 01:09:02.757428 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:02.757083 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" event={"ID":"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5","Type":"ContainerDied","Data":"4ee0c460d4b3d560941b955af05a49b91d1e7a331206b33132a7967b82d3ee22"} Jun 10 01:09:03.762964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:03.762926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" event={"ID":"c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5","Type":"ContainerStarted","Data":"09e8087b6ada98b218f123ea8493f544a6e735ffdd1ba7d3c32bfb1c1f672d65"} Jun 10 01:09:03.763436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:03.763058 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:09:03.784228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:03.784173 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" podStartSLOduration=2.328494317 podStartE2EDuration="6.784157562s" totalImagesPullingTime="3.487106654s" totalInitContainerRuntime="968.556591ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:03.782458731 +0000 UTC m=+484.359809858" watchObservedRunningTime="2026-06-10 01:09:03.784157562 +0000 UTC m=+484.361508686" Jun 10 01:09:14.769630 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:14.769600 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-g26z4" Jun 10 01:09:16.318118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.318069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:16.493511 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.493472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:16.661037 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.660949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:16.790199 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.790164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:16.887112 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.887076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:16.896366 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.895945 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74976d49cb-27tct"] Jun 10 01:09:16.902837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.902648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:16.906682 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.906657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s5hz9\"" Jun 10 01:09:16.906840 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.906657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 01:09:16.906840 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.906657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 01:09:16.910711 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:16.910674 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74976d49cb-27tct"] Jun 10 01:09:17.075770 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.075726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-tls-certs\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.075978 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.075861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-tmp\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.075978 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.075909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxk55\" (UniqueName: \"kubernetes.io/projected/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-kube-api-access-fxk55\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.159674 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.159638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:17.176720 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.176692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-tmp\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.176933 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.176730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxk55\" (UniqueName: \"kubernetes.io/projected/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-kube-api-access-fxk55\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.176933 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.176778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-tls-certs\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.179265 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.179238 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-tmp\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.179463 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.179447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-tls-certs\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.187604 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.187577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxk55\" (UniqueName: \"kubernetes.io/projected/8ee4d27c-4046-4a15-a4b0-1ccd398702ee-kube-api-access-fxk55\") pod \"kube-auth-proxy-74976d49cb-27tct\" (UID: \"8ee4d27c-4046-4a15-a4b0-1ccd398702ee\") " pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.213466 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.213436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" Jun 10 01:09:17.220604 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.220570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:17.320951 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.320910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:17.352934 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.352903 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74976d49cb-27tct"] Jun 10 01:09:17.354891 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:09:17.354840 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee4d27c_4046_4a15_a4b0_1ccd398702ee.slice/crio-f6035454ecaf64fbf747c8769e2f397c66de5b69a6af97a9b979f6e7083d79e2 WatchSource:0}: Error finding container f6035454ecaf64fbf747c8769e2f397c66de5b69a6af97a9b979f6e7083d79e2: Status 404 returned error can't find the container with id f6035454ecaf64fbf747c8769e2f397c66de5b69a6af97a9b979f6e7083d79e2 Jun 10 01:09:17.437530 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.437491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:17.716124 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.716091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:17.820709 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:17.820673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" event={"ID":"8ee4d27c-4046-4a15-a4b0-1ccd398702ee","Type":"ContainerStarted","Data":"f6035454ecaf64fbf747c8769e2f397c66de5b69a6af97a9b979f6e7083d79e2"} Jun 10 01:09:18.009739 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:18.009644 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:20.837670 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:20.837631 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" event={"ID":"8ee4d27c-4046-4a15-a4b0-1ccd398702ee","Type":"ContainerStarted","Data":"c11297954481362d8b7592e539b751b61fd4962be3896e780d92d4af24d417bf"} Jun 10 01:09:20.868970 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:20.868910 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74976d49cb-27tct" podStartSLOduration=1.871275916 podStartE2EDuration="4.868893316s" totalImagesPullingTime="2.9976174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:20.867175986 +0000 UTC m=+501.444527132" watchObservedRunningTime="2026-06-10 01:09:20.868893316 +0000 UTC m=+501.446244449" Jun 10 01:09:26.574792 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:26.574753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:26.674204 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:26.674155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:26.824069 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:26.824032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:27.330589 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:27.330549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:27.888986 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:27.888943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:27.979930 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:27.979892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:33.616645 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:33.616597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:33.716950 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:33.716912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:34.755669 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:34.755634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:34.856896 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:34.856847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:35.538905 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:35.538845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:35.642308 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:35.642270 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:36.171350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:36.171307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:46.136124 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:46.136088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:46.231846 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:46.231813 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:46.563856 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:46.563817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:46.664715 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:46.664676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:46.771301 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:46.771268 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:50.295926 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:50.295856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:50.395845 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:50.395814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:50.596138 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:50.596056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:50.802164 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:50.802130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:50.926123 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:50.926034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:56.015733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.015701 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6c9bfb4667-4c2t9"] Jun 10 01:09:56.020092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.020068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.022632 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.022602 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d44h2\"" Jun 10 01:09:56.022781 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.022657 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 01:09:56.028749 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.028722 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6c9bfb4667-4c2t9"] Jun 10 01:09:56.034521 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.034497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:56.109883 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.109847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce1277a3-2c9c-4d88-b68d-06318ed6064c-redirect-config\") pod \"dashboard-redirect-6c9bfb4667-4c2t9\" (UID: \"ce1277a3-2c9c-4d88-b68d-06318ed6064c\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.110063 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.109961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnjc\" (UniqueName: \"kubernetes.io/projected/ce1277a3-2c9c-4d88-b68d-06318ed6064c-kube-api-access-qtnjc\") pod \"dashboard-redirect-6c9bfb4667-4c2t9\" (UID: \"ce1277a3-2c9c-4d88-b68d-06318ed6064c\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.210693 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.210654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnjc\" (UniqueName: \"kubernetes.io/projected/ce1277a3-2c9c-4d88-b68d-06318ed6064c-kube-api-access-qtnjc\") pod \"dashboard-redirect-6c9bfb4667-4c2t9\" (UID: \"ce1277a3-2c9c-4d88-b68d-06318ed6064c\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.210845 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.210719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce1277a3-2c9c-4d88-b68d-06318ed6064c-redirect-config\") pod \"dashboard-redirect-6c9bfb4667-4c2t9\" (UID: \"ce1277a3-2c9c-4d88-b68d-06318ed6064c\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.211411 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.211389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce1277a3-2c9c-4d88-b68d-06318ed6064c-redirect-config\") pod \"dashboard-redirect-6c9bfb4667-4c2t9\" (UID: \"ce1277a3-2c9c-4d88-b68d-06318ed6064c\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.218938 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.218907 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnjc\" (UniqueName: \"kubernetes.io/projected/ce1277a3-2c9c-4d88-b68d-06318ed6064c-kube-api-access-qtnjc\") pod \"dashboard-redirect-6c9bfb4667-4c2t9\" (UID: \"ce1277a3-2c9c-4d88-b68d-06318ed6064c\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.330985 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.330908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" Jun 10 01:09:56.459172 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.459145 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6c9bfb4667-4c2t9"] Jun 10 01:09:56.461586 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:09:56.461559 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1277a3_2c9c_4d88_b68d_06318ed6064c.slice/crio-6a297a62401f5063623244105187eefb72cc8e1ffef03a4b2f855d9be375002c WatchSource:0}: Error finding container 6a297a62401f5063623244105187eefb72cc8e1ffef03a4b2f855d9be375002c: Status 404 returned error can't find the container with id 6a297a62401f5063623244105187eefb72cc8e1ffef03a4b2f855d9be375002c Jun 10 01:09:56.995299 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:56.995266 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" event={"ID":"ce1277a3-2c9c-4d88-b68d-06318ed6064c","Type":"ContainerStarted","Data":"6a297a62401f5063623244105187eefb72cc8e1ffef03a4b2f855d9be375002c"} Jun 10 01:09:59.004833 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:59.004792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" event={"ID":"ce1277a3-2c9c-4d88-b68d-06318ed6064c","Type":"ContainerStarted","Data":"00191f17c4f9bd2fdc1abc30d90eda4d15c54667b6e5124a20b902f9239aa196"} Jun 10 01:09:59.020084 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:09:59.020039 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6c9bfb4667-4c2t9" podStartSLOduration=2.06801079 podStartE2EDuration="4.020025292s" totalImagesPullingTime="1.952014502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:59.018502258 +0000 UTC m=+539.595853400" watchObservedRunningTime="2026-06-10 01:09:59.020025292 +0000 UTC m=+539.597376466" Jun 10 01:10:17.930582 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:17.930542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:18.894437 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:18.894402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:19.075117 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:19.075079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:47.693664 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:47.693626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:48.292583 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:48.292545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:52.720755 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:52.720704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:53.017361 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:53.017266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:53.118858 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:53.118820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:54.452057 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:54.452022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:54.558280 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:54.558244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:54.955175 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:54.955137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:55.109855 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:55.109819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:57.575652 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:57.575616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:57.742175 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:57.742132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:59.717083 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.717040 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr"] Jun 10 01:10:59.719505 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.719486 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:10:59.722131 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.722108 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:10:59.722131 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.722124 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bpkh6\"" Jun 10 01:10:59.723003 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.722982 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:10:59.723119 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.722982 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 01:10:59.731551 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.731527 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr"] Jun 10 01:10:59.852742 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.852717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:10:59.852931 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.852717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:10:59.855428 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.855392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smnp\" (UniqueName: \"kubernetes.io/projected/a8acbcc7-ea2c-4874-a537-bd75b8c74c86-kube-api-access-7smnp\") pod \"dns-operator-controller-manager-864dd78c4c-qlmvr\" (UID: \"a8acbcc7-ea2c-4874-a537-bd75b8c74c86\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:10:59.956637 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.956596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smnp\" (UniqueName: \"kubernetes.io/projected/a8acbcc7-ea2c-4874-a537-bd75b8c74c86-kube-api-access-7smnp\") pod \"dns-operator-controller-manager-864dd78c4c-qlmvr\" (UID: \"a8acbcc7-ea2c-4874-a537-bd75b8c74c86\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:10:59.972327 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.972246 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:10:59.982552 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.982525 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:10:59.993395 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:10:59.993365 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smnp\" (UniqueName: \"kubernetes.io/projected/a8acbcc7-ea2c-4874-a537-bd75b8c74c86-kube-api-access-7smnp\") pod \"dns-operator-controller-manager-864dd78c4c-qlmvr\" (UID: \"a8acbcc7-ea2c-4874-a537-bd75b8c74c86\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:11:00.032229 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:00.032196 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bpkh6\"" Jun 10 01:11:00.039974 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:00.039945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:11:00.176541 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:00.176514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr"] Jun 10 01:11:00.179487 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:11:00.179462 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8acbcc7_ea2c_4874_a537_bd75b8c74c86.slice/crio-6f722655b77728a1399d5239a437c9ddb4e717d6d39168a082cd907fd813c9b4 WatchSource:0}: Error finding container 6f722655b77728a1399d5239a437c9ddb4e717d6d39168a082cd907fd813c9b4: Status 404 returned error can't find the container with id 6f722655b77728a1399d5239a437c9ddb4e717d6d39168a082cd907fd813c9b4 Jun 10 01:11:00.265916 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:00.265794 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" event={"ID":"a8acbcc7-ea2c-4874-a537-bd75b8c74c86","Type":"ContainerStarted","Data":"6f722655b77728a1399d5239a437c9ddb4e717d6d39168a082cd907fd813c9b4"} Jun 10 01:11:00.508962 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:00.508920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:01.178391 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:01.178359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:02.320370 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.320338 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx"] Jun 10 01:11:02.322557 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.322536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:02.324871 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.324847 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5b84v\"" Jun 10 01:11:02.337905 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.337315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx"] Jun 10 01:11:02.480277 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.480225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwssc\" (UniqueName: \"kubernetes.io/projected/5e2df6fc-9513-4675-a27d-5f1c1ca730b1-kube-api-access-kwssc\") pod \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" (UID: \"5e2df6fc-9513-4675-a27d-5f1c1ca730b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:02.581633 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.581546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwssc\" (UniqueName: \"kubernetes.io/projected/5e2df6fc-9513-4675-a27d-5f1c1ca730b1-kube-api-access-kwssc\") pod \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" (UID: \"5e2df6fc-9513-4675-a27d-5f1c1ca730b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:02.589994 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.589958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwssc\" (UniqueName: \"kubernetes.io/projected/5e2df6fc-9513-4675-a27d-5f1c1ca730b1-kube-api-access-kwssc\") pod \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" (UID: \"5e2df6fc-9513-4675-a27d-5f1c1ca730b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:02.632963 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.632846 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:02.771000 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.770974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 01:11:02.885095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:02.885070 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx"] Jun 10 01:11:02.887234 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:11:02.887210 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2df6fc_9513_4675_a27d_5f1c1ca730b1.slice/crio-b454da49861989c380ba131514895d14f266335008db5ce7e25c6d9a181dc9fc WatchSource:0}: Error finding container b454da49861989c380ba131514895d14f266335008db5ce7e25c6d9a181dc9fc: Status 404 returned error can't find the container with id b454da49861989c380ba131514895d14f266335008db5ce7e25c6d9a181dc9fc Jun 10 01:11:03.281865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:03.281827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" event={"ID":"a8acbcc7-ea2c-4874-a537-bd75b8c74c86","Type":"ContainerStarted","Data":"ac616d0337ab994f90884bfec009f37187166a7c54779c113ba5d4332fbdf3cb"} Jun 10 01:11:03.282106 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:03.281948 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:11:03.283219 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:03.283193 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" event={"ID":"5e2df6fc-9513-4675-a27d-5f1c1ca730b1","Type":"ContainerStarted","Data":"b454da49861989c380ba131514895d14f266335008db5ce7e25c6d9a181dc9fc"} Jun 10 01:11:03.305449 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:03.305392 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" podStartSLOduration=1.718917427 podStartE2EDuration="4.305376487s" totalImagesPullingTime="2.58645906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:03.303812472 +0000 UTC m=+603.881163610" watchObservedRunningTime="2026-06-10 01:11:03.305376487 +0000 UTC m=+603.882727611" Jun 10 01:11:03.853643 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:03.853609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:04.553975 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:04.553929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:04.612042 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:04.612002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:05.312678 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:05.312632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:05.368038 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:05.367998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:06.299602 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:06.299564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" event={"ID":"5e2df6fc-9513-4675-a27d-5f1c1ca730b1","Type":"ContainerStarted","Data":"85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad"} Jun 10 01:11:06.299769 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:06.299686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:06.315188 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:06.315156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:06.322781 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:06.322735 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" podStartSLOduration=1.8350528430000002 podStartE2EDuration="4.322718631s" totalImagesPullingTime="2.487665788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:06.320968923 +0000 UTC m=+606.898320048" watchObservedRunningTime="2026-06-10 01:11:06.322718631 +0000 UTC m=+606.900069755" Jun 10 01:11:06.445226 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:06.445185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:07.160609 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:07.160575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:07.764248 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:07.764194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:08.674273 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:08.674243 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:08.775046 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:08.775015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:10.718497 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:10.718455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:10.774914 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:10.774853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:13.166389 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:13.166348 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:13.271863 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:13.271818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:14.290895 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:14.290794 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlmvr" Jun 10 01:11:14.948060 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:14.948013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:15.037486 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:15.037449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:17.306632 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:17.306599 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.107439 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.107406 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx"] Jun 10 01:11:18.107657 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.107630 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" containerName="manager" containerID="cri-o://85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad" gracePeriod=2 Jun 10 01:11:18.123676 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.123641 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx"] Jun 10 01:11:18.135935 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.135900 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl"] Jun 10 01:11:18.136419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.136398 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" containerName="manager" Jun 10 01:11:18.136527 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.136424 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" containerName="manager" Jun 10 01:11:18.136588 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.136557 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" containerName="manager" Jun 10 01:11:18.138968 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.138946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:18.143369 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:18.143333 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5e2df6fc-9513-4675-a27d-5f1c1ca730b1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-dxxjx\": pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.145418 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:18.145390 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.150715 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.150686 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl"] Jun 10 01:11:18.325077 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.325045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvl7j\" (UniqueName: \"kubernetes.io/projected/6de4b75c-175b-4a0d-a6ff-c6e1047ce377-kube-api-access-cvl7j\") pod \"limitador-operator-controller-manager-859d7b78bd-45xbl\" (UID: \"6de4b75c-175b-4a0d-a6ff-c6e1047ce377\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:18.349287 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.349261 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.351293 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:18.351257 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.354539 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.354514 2565 generic.go:356] "Generic (PLEG): container finished" podID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" containerID="85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad" exitCode=0 Jun 10 01:11:18.354659 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.354555 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.354659 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.354610 2565 scope.go:117] "RemoveContainer" containerID="85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad" Jun 10 01:11:18.356625 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:18.356605 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.362820 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.362803 2565 scope.go:117] "RemoveContainer" containerID="85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad" Jun 10 01:11:18.363121 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:18.363100 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad\": container with ID starting with 85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad not found: ID does not exist" containerID="85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad" Jun 10 01:11:18.363175 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.363131 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad"} err="failed to get container status \"85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad\": rpc error: code = NotFound desc = could not find container \"85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad\": container with ID starting with 85efcb1641c07256a34fab6a149a17af2b4b13ea509f5a9190eeabb6d0f8edad not found: ID does not exist" Jun 10 01:11:18.426136 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.426092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvl7j\" (UniqueName: \"kubernetes.io/projected/6de4b75c-175b-4a0d-a6ff-c6e1047ce377-kube-api-access-cvl7j\") pod \"limitador-operator-controller-manager-859d7b78bd-45xbl\" (UID: \"6de4b75c-175b-4a0d-a6ff-c6e1047ce377\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:18.436282 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.436247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvl7j\" (UniqueName: \"kubernetes.io/projected/6de4b75c-175b-4a0d-a6ff-c6e1047ce377-kube-api-access-cvl7j\") pod \"limitador-operator-controller-manager-859d7b78bd-45xbl\" (UID: \"6de4b75c-175b-4a0d-a6ff-c6e1047ce377\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:18.484609 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.484567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:18.527081 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.527050 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwssc\" (UniqueName: \"kubernetes.io/projected/5e2df6fc-9513-4675-a27d-5f1c1ca730b1-kube-api-access-kwssc\") pod \"5e2df6fc-9513-4675-a27d-5f1c1ca730b1\" (UID: \"5e2df6fc-9513-4675-a27d-5f1c1ca730b1\") " Jun 10 01:11:18.529361 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.529328 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2df6fc-9513-4675-a27d-5f1c1ca730b1-kube-api-access-kwssc" (OuterVolumeSpecName: "kube-api-access-kwssc") pod "5e2df6fc-9513-4675-a27d-5f1c1ca730b1" (UID: "5e2df6fc-9513-4675-a27d-5f1c1ca730b1"). InnerVolumeSpecName "kube-api-access-kwssc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:11:18.622462 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.622432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl"] Jun 10 01:11:18.624889 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:11:18.624840 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de4b75c_175b_4a0d_a6ff_c6e1047ce377.slice/crio-25c0f28ec560e641517710df7a2be5f196beb795b58d04f7a04634e483e3d958 WatchSource:0}: Error finding container 25c0f28ec560e641517710df7a2be5f196beb795b58d04f7a04634e483e3d958: Status 404 returned error can't find the container with id 25c0f28ec560e641517710df7a2be5f196beb795b58d04f7a04634e483e3d958 Jun 10 01:11:18.628065 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.628044 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwssc\" (UniqueName: \"kubernetes.io/projected/5e2df6fc-9513-4675-a27d-5f1c1ca730b1-kube-api-access-kwssc\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:11:18.672459 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:18.672425 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:18.921174 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:18.921081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:19.021093 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:19.021050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:19.363276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:19.363238 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" event={"ID":"6de4b75c-175b-4a0d-a6ff-c6e1047ce377","Type":"ContainerStarted","Data":"7e573361e87dfa10e31cb022ed79f8d6c8d71e5cdbdd15fadacb65ed02c145c4"} Jun 10 01:11:19.363679 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:19.363295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" event={"ID":"6de4b75c-175b-4a0d-a6ff-c6e1047ce377","Type":"ContainerStarted","Data":"25c0f28ec560e641517710df7a2be5f196beb795b58d04f7a04634e483e3d958"} Jun 10 01:11:19.363679 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:19.363344 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:19.365165 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:19.365138 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:19.391933 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:19.391856 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" podStartSLOduration=1.391837866 podStartE2EDuration="1.391837866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:19.390435324 +0000 UTC m=+619.967786490" watchObservedRunningTime="2026-06-10 01:11:19.391837866 +0000 UTC m=+619.969189050" Jun 10 01:11:19.876277 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:19.876241 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxxjx\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxxjx" Jun 10 01:11:19.877495 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:19.877473 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2df6fc-9513-4675-a27d-5f1c1ca730b1" path="/var/lib/kubelet/pods/5e2df6fc-9513-4675-a27d-5f1c1ca730b1/volumes" Jun 10 01:11:23.107741 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:23.107696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:23.207590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:23.207552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:26.903376 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:26.903338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:27.004296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:27.004261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:27.314170 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:27.314138 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:27.371387 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:27.371356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:30.369768 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:30.369734 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45xbl" Jun 10 01:11:30.921321 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:30.921285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:31.027391 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:31.027345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:37.118595 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:37.118547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:37.202544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:37.202514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:38.500798 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:38.500761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:38.552091 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:38.552056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:41.837671 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:41.837632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:41.941317 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:41.941282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:45.661539 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:45.661494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:45.741648 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:45.741613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:46.064507 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:46.064469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:46.142931 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:46.142869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:47.029736 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:47.029699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:47.507614 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:47.507579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:49.544847 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:49.544806 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:49.636283 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:49.636255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:49.706847 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:49.706795 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:50.303578 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.303545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:50.418420 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.418384 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wqzm7"] Jun 10 01:11:50.421813 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.421795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:50.425456 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.425429 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7qkx7\"" Jun 10 01:11:50.439774 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.439736 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqzm7"] Jun 10 01:11:50.467293 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.467251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:50.506858 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.506817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htcfb\" (UniqueName: \"kubernetes.io/projected/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1-kube-api-access-htcfb\") pod \"authorino-58cd955675-wqzm7\" (UID: \"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1\") " pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:50.608216 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.608132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htcfb\" (UniqueName: \"kubernetes.io/projected/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1-kube-api-access-htcfb\") pod \"authorino-58cd955675-wqzm7\" (UID: \"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1\") " pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:50.625309 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.625274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htcfb\" (UniqueName: \"kubernetes.io/projected/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1-kube-api-access-htcfb\") pod \"authorino-58cd955675-wqzm7\" (UID: \"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1\") " pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:50.695257 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.695220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:50.740309 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.740266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:50.850089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.850055 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xpvkq"] Jun 10 01:11:50.859183 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.859096 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:11:50.860542 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.860512 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xpvkq"] Jun 10 01:11:50.893350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:50.893326 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqzm7"] Jun 10 01:11:50.895786 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:11:50.895750 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d3a1b8e_3356_4243_9bd7_ee8fe9361ad1.slice/crio-c86da5bf67dda74f965d018e2cf0756d1dfe7d2fedfaaf735e7c8e8770c2e710 WatchSource:0}: Error finding container c86da5bf67dda74f965d018e2cf0756d1dfe7d2fedfaaf735e7c8e8770c2e710: Status 404 returned error can't find the container with id c86da5bf67dda74f965d018e2cf0756d1dfe7d2fedfaaf735e7c8e8770c2e710 Jun 10 01:11:51.012039 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.011998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfgb8\" (UniqueName: \"kubernetes.io/projected/7fcfd6f7-822f-46e0-8538-d6d025062260-kube-api-access-bfgb8\") pod \"authorino-75d556bd77-xpvkq\" (UID: \"7fcfd6f7-822f-46e0-8538-d6d025062260\") " pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:11:51.113158 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.113065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfgb8\" (UniqueName: \"kubernetes.io/projected/7fcfd6f7-822f-46e0-8538-d6d025062260-kube-api-access-bfgb8\") pod \"authorino-75d556bd77-xpvkq\" (UID: \"7fcfd6f7-822f-46e0-8538-d6d025062260\") " pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:11:51.122026 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.121997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfgb8\" (UniqueName: \"kubernetes.io/projected/7fcfd6f7-822f-46e0-8538-d6d025062260-kube-api-access-bfgb8\") pod \"authorino-75d556bd77-xpvkq\" (UID: \"7fcfd6f7-822f-46e0-8538-d6d025062260\") " pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:11:51.170940 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.170856 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:11:51.303849 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.303821 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xpvkq"] Jun 10 01:11:51.306187 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:11:51.306153 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fcfd6f7_822f_46e0_8538_d6d025062260.slice/crio-9796fee52b784942899d0d76ec643a6752109d87058f5020272b71219cd804bc WatchSource:0}: Error finding container 9796fee52b784942899d0d76ec643a6752109d87058f5020272b71219cd804bc: Status 404 returned error can't find the container with id 9796fee52b784942899d0d76ec643a6752109d87058f5020272b71219cd804bc Jun 10 01:11:51.510216 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.510179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqzm7" event={"ID":"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1","Type":"ContainerStarted","Data":"c86da5bf67dda74f965d018e2cf0756d1dfe7d2fedfaaf735e7c8e8770c2e710"} Jun 10 01:11:51.511333 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:51.511303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xpvkq" event={"ID":"7fcfd6f7-822f-46e0-8538-d6d025062260","Type":"ContainerStarted","Data":"9796fee52b784942899d0d76ec643a6752109d87058f5020272b71219cd804bc"} Jun 10 01:11:55.535396 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:55.535359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqzm7" event={"ID":"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1","Type":"ContainerStarted","Data":"04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c"} Jun 10 01:11:55.536837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:55.536806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xpvkq" event={"ID":"7fcfd6f7-822f-46e0-8538-d6d025062260","Type":"ContainerStarted","Data":"d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99"} Jun 10 01:11:55.551452 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:55.551391 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wqzm7" podStartSLOduration=1.860162285 podStartE2EDuration="5.5513703s" totalImagesPullingTime="3.691208015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:55.550017199 +0000 UTC m=+656.127368326" watchObservedRunningTime="2026-06-10 01:11:55.5513703 +0000 UTC m=+656.128721429" Jun 10 01:11:55.566276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:55.566225 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xpvkq" podStartSLOduration=2.273723761 podStartE2EDuration="5.566206868s" totalImagesPullingTime="3.292483107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:55.565118744 +0000 UTC m=+656.142469869" watchObservedRunningTime="2026-06-10 01:11:55.566206868 +0000 UTC m=+656.143557993" Jun 10 01:11:55.599082 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:55.599046 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqzm7"] Jun 10 01:11:57.545207 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:57.545146 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wqzm7" podUID="7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" containerName="authorino" containerID="cri-o://04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c" gracePeriod=30 Jun 10 01:11:57.798328 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:57.798253 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:57.867695 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:57.867657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:57.876428 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:57.876400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htcfb\" (UniqueName: \"kubernetes.io/projected/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1-kube-api-access-htcfb\") pod \"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1\" (UID: \"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1\") " Jun 10 01:11:57.878723 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:57.878686 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1-kube-api-access-htcfb" (OuterVolumeSpecName: "kube-api-access-htcfb") pod "7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" (UID: "7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1"). InnerVolumeSpecName "kube-api-access-htcfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:11:57.977914 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:57.977833 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htcfb\" (UniqueName: \"kubernetes.io/projected/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1-kube-api-access-htcfb\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:11:58.551353 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.551319 2565 generic.go:356] "Generic (PLEG): container finished" podID="7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" containerID="04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c" exitCode=0 Jun 10 01:11:58.551762 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.551361 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqzm7" Jun 10 01:11:58.551762 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.551396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqzm7" event={"ID":"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1","Type":"ContainerDied","Data":"04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c"} Jun 10 01:11:58.551762 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.551439 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqzm7" event={"ID":"7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1","Type":"ContainerDied","Data":"c86da5bf67dda74f965d018e2cf0756d1dfe7d2fedfaaf735e7c8e8770c2e710"} Jun 10 01:11:58.551762 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.551457 2565 scope.go:117] "RemoveContainer" containerID="04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c" Jun 10 01:11:58.560942 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.560682 2565 scope.go:117] "RemoveContainer" containerID="04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c" Jun 10 01:11:58.561090 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:11:58.561066 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c\": container with ID starting with 04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c not found: ID does not exist" containerID="04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c" Jun 10 01:11:58.561153 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.561102 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c"} err="failed to get container status \"04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c\": rpc error: code = NotFound desc = could not find container \"04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c\": container with ID starting with 04e4fddf52f3532f995ba1c1c6d297ca1d01e4b9c7ddfbfa714326f21a15d43c not found: ID does not exist" Jun 10 01:11:58.574165 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.574127 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqzm7"] Jun 10 01:11:58.576400 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.576372 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqzm7"] Jun 10 01:11:58.616988 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:58.616940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:11:59.878127 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:11:59.878101 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" path="/var/lib/kubelet/pods/7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1/volumes" Jun 10 01:12:01.484002 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:01.483956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:01.582903 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:01.582844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:10.647608 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:10.647572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:14.545137 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:14.545096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:18.469865 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:18.469831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:18.819062 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:18.818965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:23.944736 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:23.944695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:24.044285 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:24.044234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:24.193562 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:24.193526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:48.383189 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.383150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:48.580784 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.580749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:48.889854 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.889822 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:12:48.890381 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.890359 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" containerName="authorino" Jun 10 01:12:48.890381 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.890381 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" containerName="authorino" Jun 10 01:12:48.890612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.890462 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d3a1b8e-3356-4243-9bd7-ee8fe9361ad1" containerName="authorino" Jun 10 01:12:48.893376 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.893357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:48.895729 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.895707 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 01:12:48.896769 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.896752 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 01:12:48.896858 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.896766 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6vtmw\"" Jun 10 01:12:48.896858 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.896816 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 01:12:48.902396 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:48.902368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:12:49.024097 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:49.023621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwsxl\" (UniqueName: \"kubernetes.io/projected/e099ef07-cebd-4857-9fea-d6a2bfbed154-kube-api-access-dwsxl\") pod \"maas-keycloak-0\" (UID: \"e099ef07-cebd-4857-9fea-d6a2bfbed154\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:49.125149 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:49.125107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwsxl\" (UniqueName: \"kubernetes.io/projected/e099ef07-cebd-4857-9fea-d6a2bfbed154-kube-api-access-dwsxl\") pod \"maas-keycloak-0\" (UID: \"e099ef07-cebd-4857-9fea-d6a2bfbed154\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:49.133569 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:49.133540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwsxl\" (UniqueName: \"kubernetes.io/projected/e099ef07-cebd-4857-9fea-d6a2bfbed154-kube-api-access-dwsxl\") pod \"maas-keycloak-0\" (UID: \"e099ef07-cebd-4857-9fea-d6a2bfbed154\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:49.203469 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:49.203433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:49.374487 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:49.374456 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:12:49.377094 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:12:49.377069 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode099ef07_cebd_4857_9fea_d6a2bfbed154.slice/crio-009e535a9d8848fda014e0e13d3a66ea908aed20861d760582f1bd031bb71d6e WatchSource:0}: Error finding container 009e535a9d8848fda014e0e13d3a66ea908aed20861d760582f1bd031bb71d6e: Status 404 returned error can't find the container with id 009e535a9d8848fda014e0e13d3a66ea908aed20861d760582f1bd031bb71d6e Jun 10 01:12:49.783460 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:49.783421 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e099ef07-cebd-4857-9fea-d6a2bfbed154","Type":"ContainerStarted","Data":"009e535a9d8848fda014e0e13d3a66ea908aed20861d760582f1bd031bb71d6e"} Jun 10 01:12:56.823273 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:56.823230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e099ef07-cebd-4857-9fea-d6a2bfbed154","Type":"ContainerStarted","Data":"1a8fac5735c6060f0839c20d49ab7e08f9228bafb3960f836774c7e79f738da0"} Jun 10 01:12:56.843613 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:56.843542 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.368913407 podStartE2EDuration="8.843519784s" totalImagesPullingTime="6.474606377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:56.840779738 +0000 UTC m=+717.418130865" watchObservedRunningTime="2026-06-10 01:12:56.843519784 +0000 UTC m=+717.420870911" Jun 10 01:12:57.204350 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:57.204302 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:57.206269 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:57.206224 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:12:57.318934 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:57.318853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:12:58.204257 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:58.204197 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:12:59.204228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:59.204187 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:12:59.204659 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:12:59.204534 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:00.204506 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:00.204079 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:01.204088 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:01.204033 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:02.204449 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:02.204392 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:03.204828 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:03.204783 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:04.204924 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:04.204860 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:05.204614 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:05.204567 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:06.204400 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:06.204346 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:07.204123 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:07.204074 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:08.204578 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:08.204529 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:13:09.312318 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:09.312277 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 01:13:09.326456 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:09.326405 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:13:19.319044 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:19.318998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:13:19.995785 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:19.995744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:20.189594 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.189557 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mxsrf"] Jun 10 01:13:20.192151 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.192126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:20.203010 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.202986 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mxsrf"] Jun 10 01:13:20.243188 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.243150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:20.331029 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.330921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66p8w\" (UniqueName: \"kubernetes.io/projected/e81940b9-3fed-4437-8ac9-13e9ebf7bf84-kube-api-access-66p8w\") pod \"authorino-5d4b67c446-mxsrf\" (UID: \"e81940b9-3fed-4437-8ac9-13e9ebf7bf84\") " pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:20.419678 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.419634 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mxsrf"] Jun 10 01:13:20.420021 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:13:20.419997 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-66p8w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-mxsrf" podUID="e81940b9-3fed-4437-8ac9-13e9ebf7bf84" Jun 10 01:13:20.432013 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.431980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66p8w\" (UniqueName: \"kubernetes.io/projected/e81940b9-3fed-4437-8ac9-13e9ebf7bf84-kube-api-access-66p8w\") pod \"authorino-5d4b67c446-mxsrf\" (UID: \"e81940b9-3fed-4437-8ac9-13e9ebf7bf84\") " pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:20.440208 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.440181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66p8w\" (UniqueName: \"kubernetes.io/projected/e81940b9-3fed-4437-8ac9-13e9ebf7bf84-kube-api-access-66p8w\") pod \"authorino-5d4b67c446-mxsrf\" (UID: \"e81940b9-3fed-4437-8ac9-13e9ebf7bf84\") " pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:20.442707 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.442678 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d6fcfff9c-4f8jc"] Jun 10 01:13:20.445036 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.445017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:20.453836 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.453800 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6fcfff9c-4f8jc"] Jun 10 01:13:20.533377 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.533335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpmkq\" (UniqueName: \"kubernetes.io/projected/9b69a40f-3fa7-49a0-a149-f9974d419a84-kube-api-access-fpmkq\") pod \"authorino-7d6fcfff9c-4f8jc\" (UID: \"9b69a40f-3fa7-49a0-a149-f9974d419a84\") " pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:20.634145 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.634027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmkq\" (UniqueName: \"kubernetes.io/projected/9b69a40f-3fa7-49a0-a149-f9974d419a84-kube-api-access-fpmkq\") pod \"authorino-7d6fcfff9c-4f8jc\" (UID: \"9b69a40f-3fa7-49a0-a149-f9974d419a84\") " pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:20.644832 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.644803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpmkq\" (UniqueName: \"kubernetes.io/projected/9b69a40f-3fa7-49a0-a149-f9974d419a84-kube-api-access-fpmkq\") pod \"authorino-7d6fcfff9c-4f8jc\" (UID: \"9b69a40f-3fa7-49a0-a149-f9974d419a84\") " pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:20.645427 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.645402 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d6fcfff9c-4f8jc"] Jun 10 01:13:20.645659 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.645648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:20.670940 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.670909 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5565d8b64f-zfpcz"] Jun 10 01:13:20.673541 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.673519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.675861 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.675838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 01:13:20.683435 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.683407 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5565d8b64f-zfpcz"] Jun 10 01:13:20.781611 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.781587 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d6fcfff9c-4f8jc"] Jun 10 01:13:20.784274 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:13:20.784241 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b69a40f_3fa7_49a0_a149_f9974d419a84.slice/crio-9c772842607e294cd3e67bfc476707e1b0df16374f8e86fb2cbd7bc661fa6b99 WatchSource:0}: Error finding container 9c772842607e294cd3e67bfc476707e1b0df16374f8e86fb2cbd7bc661fa6b99: Status 404 returned error can't find the container with id 9c772842607e294cd3e67bfc476707e1b0df16374f8e86fb2cbd7bc661fa6b99 Jun 10 01:13:20.836220 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.836178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff668094-f2f3-438c-9668-319f4a4d6062-tls-cert\") pod \"authorino-5565d8b64f-zfpcz\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.836396 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.836254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttk4q\" (UniqueName: \"kubernetes.io/projected/ff668094-f2f3-438c-9668-319f4a4d6062-kube-api-access-ttk4q\") pod \"authorino-5565d8b64f-zfpcz\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.936964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.936840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff668094-f2f3-438c-9668-319f4a4d6062-tls-cert\") pod \"authorino-5565d8b64f-zfpcz\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.936964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.936931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttk4q\" (UniqueName: \"kubernetes.io/projected/ff668094-f2f3-438c-9668-319f4a4d6062-kube-api-access-ttk4q\") pod \"authorino-5565d8b64f-zfpcz\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.939460 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.939429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff668094-f2f3-438c-9668-319f4a4d6062-tls-cert\") pod \"authorino-5565d8b64f-zfpcz\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.945804 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.945779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttk4q\" (UniqueName: \"kubernetes.io/projected/ff668094-f2f3-438c-9668-319f4a4d6062-kube-api-access-ttk4q\") pod \"authorino-5565d8b64f-zfpcz\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:20.962760 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.962731 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:20.962935 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.962735 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" event={"ID":"9b69a40f-3fa7-49a0-a149-f9974d419a84","Type":"ContainerStarted","Data":"9c772842607e294cd3e67bfc476707e1b0df16374f8e86fb2cbd7bc661fa6b99"} Jun 10 01:13:20.969090 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.969067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:20.984436 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:20.984409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:13:21.038084 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.038048 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66p8w\" (UniqueName: \"kubernetes.io/projected/e81940b9-3fed-4437-8ac9-13e9ebf7bf84-kube-api-access-66p8w\") pod \"e81940b9-3fed-4437-8ac9-13e9ebf7bf84\" (UID: \"e81940b9-3fed-4437-8ac9-13e9ebf7bf84\") " Jun 10 01:13:21.040954 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.040921 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81940b9-3fed-4437-8ac9-13e9ebf7bf84-kube-api-access-66p8w" (OuterVolumeSpecName: "kube-api-access-66p8w") pod "e81940b9-3fed-4437-8ac9-13e9ebf7bf84" (UID: "e81940b9-3fed-4437-8ac9-13e9ebf7bf84"). InnerVolumeSpecName "kube-api-access-66p8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:21.115816 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.115710 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5565d8b64f-zfpcz"] Jun 10 01:13:21.118382 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:13:21.118353 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff668094_f2f3_438c_9668_319f4a4d6062.slice/crio-5d9e7d59bce24911e6420917f70ba4265621ccc988e2070472cb9662d4af444b WatchSource:0}: Error finding container 5d9e7d59bce24911e6420917f70ba4265621ccc988e2070472cb9662d4af444b: Status 404 returned error can't find the container with id 5d9e7d59bce24911e6420917f70ba4265621ccc988e2070472cb9662d4af444b Jun 10 01:13:21.139556 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.139528 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66p8w\" (UniqueName: \"kubernetes.io/projected/e81940b9-3fed-4437-8ac9-13e9ebf7bf84-kube-api-access-66p8w\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:13:21.969894 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.969846 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" event={"ID":"9b69a40f-3fa7-49a0-a149-f9974d419a84","Type":"ContainerStarted","Data":"73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf"} Jun 10 01:13:21.970344 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.969902 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" podUID="9b69a40f-3fa7-49a0-a149-f9974d419a84" containerName="authorino" containerID="cri-o://73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf" gracePeriod=30 Jun 10 01:13:21.971563 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.971534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" event={"ID":"ff668094-f2f3-438c-9668-319f4a4d6062","Type":"ContainerStarted","Data":"8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0"} Jun 10 01:13:21.971668 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.971576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" event={"ID":"ff668094-f2f3-438c-9668-319f4a4d6062","Type":"ContainerStarted","Data":"5d9e7d59bce24911e6420917f70ba4265621ccc988e2070472cb9662d4af444b"} Jun 10 01:13:21.971668 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.971549 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mxsrf" Jun 10 01:13:21.985379 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.985336 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" podStartSLOduration=1.616263985 podStartE2EDuration="1.985320584s" totalImagesPullingTime="369.056599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:21.984161124 +0000 UTC m=+742.561512250" watchObservedRunningTime="2026-06-10 01:13:21.985320584 +0000 UTC m=+742.562671710" Jun 10 01:13:21.999594 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:21.999537 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" podStartSLOduration=1.702448234 podStartE2EDuration="1.999519912s" totalImagesPullingTime="297.071678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:21.99735389 +0000 UTC m=+742.574705015" watchObservedRunningTime="2026-06-10 01:13:21.999519912 +0000 UTC m=+742.576871078" Jun 10 01:13:22.023198 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.023158 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mxsrf"] Jun 10 01:13:22.031011 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.030982 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xpvkq"] Jun 10 01:13:22.031197 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.031142 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xpvkq" podUID="7fcfd6f7-822f-46e0-8538-d6d025062260" containerName="authorino" containerID="cri-o://d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99" gracePeriod=30 Jun 10 01:13:22.032977 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.032951 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mxsrf"] Jun 10 01:13:22.288346 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.288320 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:22.307612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.307532 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:13:22.450960 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.450921 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfgb8\" (UniqueName: \"kubernetes.io/projected/7fcfd6f7-822f-46e0-8538-d6d025062260-kube-api-access-bfgb8\") pod \"7fcfd6f7-822f-46e0-8538-d6d025062260\" (UID: \"7fcfd6f7-822f-46e0-8538-d6d025062260\") " Jun 10 01:13:22.451127 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.450972 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpmkq\" (UniqueName: \"kubernetes.io/projected/9b69a40f-3fa7-49a0-a149-f9974d419a84-kube-api-access-fpmkq\") pod \"9b69a40f-3fa7-49a0-a149-f9974d419a84\" (UID: \"9b69a40f-3fa7-49a0-a149-f9974d419a84\") " Jun 10 01:13:22.453203 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.453176 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b69a40f-3fa7-49a0-a149-f9974d419a84-kube-api-access-fpmkq" (OuterVolumeSpecName: "kube-api-access-fpmkq") pod "9b69a40f-3fa7-49a0-a149-f9974d419a84" (UID: "9b69a40f-3fa7-49a0-a149-f9974d419a84"). InnerVolumeSpecName "kube-api-access-fpmkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:22.453290 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.453225 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fcfd6f7-822f-46e0-8538-d6d025062260-kube-api-access-bfgb8" (OuterVolumeSpecName: "kube-api-access-bfgb8") pod "7fcfd6f7-822f-46e0-8538-d6d025062260" (UID: "7fcfd6f7-822f-46e0-8538-d6d025062260"). InnerVolumeSpecName "kube-api-access-bfgb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:22.552488 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.552445 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfgb8\" (UniqueName: \"kubernetes.io/projected/7fcfd6f7-822f-46e0-8538-d6d025062260-kube-api-access-bfgb8\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:13:22.552488 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.552477 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpmkq\" (UniqueName: \"kubernetes.io/projected/9b69a40f-3fa7-49a0-a149-f9974d419a84-kube-api-access-fpmkq\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:13:22.977814 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.977772 2565 generic.go:356] "Generic (PLEG): container finished" podID="7fcfd6f7-822f-46e0-8538-d6d025062260" containerID="d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99" exitCode=0 Jun 10 01:13:22.977814 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.977817 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xpvkq" Jun 10 01:13:22.978336 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.977861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xpvkq" event={"ID":"7fcfd6f7-822f-46e0-8538-d6d025062260","Type":"ContainerDied","Data":"d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99"} Jun 10 01:13:22.978336 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.977929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xpvkq" event={"ID":"7fcfd6f7-822f-46e0-8538-d6d025062260","Type":"ContainerDied","Data":"9796fee52b784942899d0d76ec643a6752109d87058f5020272b71219cd804bc"} Jun 10 01:13:22.978336 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.977954 2565 scope.go:117] "RemoveContainer" containerID="d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99" Jun 10 01:13:22.979233 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.979210 2565 generic.go:356] "Generic (PLEG): container finished" podID="9b69a40f-3fa7-49a0-a149-f9974d419a84" containerID="73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf" exitCode=0 Jun 10 01:13:22.979294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.979247 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" Jun 10 01:13:22.979294 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.979288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" event={"ID":"9b69a40f-3fa7-49a0-a149-f9974d419a84","Type":"ContainerDied","Data":"73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf"} Jun 10 01:13:22.979388 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.979317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6fcfff9c-4f8jc" event={"ID":"9b69a40f-3fa7-49a0-a149-f9974d419a84","Type":"ContainerDied","Data":"9c772842607e294cd3e67bfc476707e1b0df16374f8e86fb2cbd7bc661fa6b99"} Jun 10 01:13:22.987331 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.987308 2565 scope.go:117] "RemoveContainer" containerID="d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99" Jun 10 01:13:22.987686 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:13:22.987660 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99\": container with ID starting with d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99 not found: ID does not exist" containerID="d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99" Jun 10 01:13:22.987766 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.987693 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99"} err="failed to get container status \"d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99\": rpc error: code = NotFound desc = could not find container \"d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99\": container with ID starting with d1f8be68bf9b25407c7388c5e40216727538231a6ab696b7b4c36c0faf2ebf99 not found: ID does not exist" Jun 10 01:13:22.987766 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.987711 2565 scope.go:117] "RemoveContainer" containerID="73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf" Jun 10 01:13:22.995697 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.995679 2565 scope.go:117] "RemoveContainer" containerID="73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf" Jun 10 01:13:22.996031 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:13:22.996003 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf\": container with ID starting with 73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf not found: ID does not exist" containerID="73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf" Jun 10 01:13:22.996122 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:22.996038 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf"} err="failed to get container status \"73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf\": rpc error: code = NotFound desc = could not find container \"73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf\": container with ID starting with 73550cbb577490113e0be6b2af1b5e0d2704a739f8400e1ce702d147605d70cf not found: ID does not exist" Jun 10 01:13:23.000687 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.000661 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xpvkq"] Jun 10 01:13:23.006956 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.006929 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xpvkq"] Jun 10 01:13:23.017490 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.017463 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d6fcfff9c-4f8jc"] Jun 10 01:13:23.020762 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.020735 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d6fcfff9c-4f8jc"] Jun 10 01:13:23.877959 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.877921 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fcfd6f7-822f-46e0-8538-d6d025062260" path="/var/lib/kubelet/pods/7fcfd6f7-822f-46e0-8538-d6d025062260/volumes" Jun 10 01:13:23.878276 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.878263 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b69a40f-3fa7-49a0-a149-f9974d419a84" path="/var/lib/kubelet/pods/9b69a40f-3fa7-49a0-a149-f9974d419a84/volumes" Jun 10 01:13:23.878566 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:23.878555 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81940b9-3fed-4437-8ac9-13e9ebf7bf84" path="/var/lib/kubelet/pods/e81940b9-3fed-4437-8ac9-13e9ebf7bf84/volumes" Jun 10 01:13:25.624651 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.624621 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:25.637076 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637046 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-746d97f49b-xf7sq"] Jun 10 01:13:25.637433 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637421 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b69a40f-3fa7-49a0-a149-f9974d419a84" containerName="authorino" Jun 10 01:13:25.637483 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637435 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b69a40f-3fa7-49a0-a149-f9974d419a84" containerName="authorino" Jun 10 01:13:25.637483 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637457 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fcfd6f7-822f-46e0-8538-d6d025062260" containerName="authorino" Jun 10 01:13:25.637483 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637463 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fcfd6f7-822f-46e0-8538-d6d025062260" containerName="authorino" Jun 10 01:13:25.637588 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637512 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b69a40f-3fa7-49a0-a149-f9974d419a84" containerName="authorino" Jun 10 01:13:25.637588 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.637521 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fcfd6f7-822f-46e0-8538-d6d025062260" containerName="authorino" Jun 10 01:13:25.640273 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.640256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.643330 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.643299 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 01:13:25.643330 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.643307 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 01:13:25.643491 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.643392 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-82p82\"" Jun 10 01:13:25.655134 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.655110 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-746d97f49b-xf7sq"] Jun 10 01:13:25.744368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.744329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:25.783654 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.783617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7802fce-25c9-4514-8954-cffec74a799e-webhook-cert\") pod \"maas-controller-746d97f49b-xf7sq\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.783828 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.783690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zphnd\" (UniqueName: \"kubernetes.io/projected/a7802fce-25c9-4514-8954-cffec74a799e-kube-api-access-zphnd\") pod \"maas-controller-746d97f49b-xf7sq\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.859702 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.859665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:25.878358 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.878285 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-665586dff6-bjp7f"] Jun 10 01:13:25.880620 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.880604 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:25.884580 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.884557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7802fce-25c9-4514-8954-cffec74a799e-webhook-cert\") pod \"maas-controller-746d97f49b-xf7sq\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.884727 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.884603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zphnd\" (UniqueName: \"kubernetes.io/projected/a7802fce-25c9-4514-8954-cffec74a799e-kube-api-access-zphnd\") pod \"maas-controller-746d97f49b-xf7sq\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.887191 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.887171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7802fce-25c9-4514-8954-cffec74a799e-webhook-cert\") pod \"maas-controller-746d97f49b-xf7sq\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.890644 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.890618 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-665586dff6-bjp7f"] Jun 10 01:13:25.893715 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.893694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zphnd\" (UniqueName: \"kubernetes.io/projected/a7802fce-25c9-4514-8954-cffec74a799e-kube-api-access-zphnd\") pod \"maas-controller-746d97f49b-xf7sq\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.950685 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.950648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:25.985560 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.985530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt9ld\" (UniqueName: \"kubernetes.io/projected/6599dfcc-952a-48fe-9b8a-10d26d7865c7-kube-api-access-gt9ld\") pod \"maas-controller-665586dff6-bjp7f\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:25.985733 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:25.985611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6599dfcc-952a-48fe-9b8a-10d26d7865c7-webhook-cert\") pod \"maas-controller-665586dff6-bjp7f\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:26.086419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.086391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt9ld\" (UniqueName: \"kubernetes.io/projected/6599dfcc-952a-48fe-9b8a-10d26d7865c7-kube-api-access-gt9ld\") pod \"maas-controller-665586dff6-bjp7f\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:26.086493 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.086457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6599dfcc-952a-48fe-9b8a-10d26d7865c7-webhook-cert\") pod \"maas-controller-665586dff6-bjp7f\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:26.086689 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.086662 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-746d97f49b-xf7sq"] Jun 10 01:13:26.088648 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:13:26.088623 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7802fce_25c9_4514_8954_cffec74a799e.slice/crio-4ab58c5602b0b938d2523fd11114eb39f433c3e1e82fad55ffbe7d13f7223a71 WatchSource:0}: Error finding container 4ab58c5602b0b938d2523fd11114eb39f433c3e1e82fad55ffbe7d13f7223a71: Status 404 returned error can't find the container with id 4ab58c5602b0b938d2523fd11114eb39f433c3e1e82fad55ffbe7d13f7223a71 Jun 10 01:13:26.089202 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.089123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6599dfcc-952a-48fe-9b8a-10d26d7865c7-webhook-cert\") pod \"maas-controller-665586dff6-bjp7f\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:26.095076 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.095051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt9ld\" (UniqueName: \"kubernetes.io/projected/6599dfcc-952a-48fe-9b8a-10d26d7865c7-kube-api-access-gt9ld\") pod \"maas-controller-665586dff6-bjp7f\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:26.209041 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.209004 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:26.342504 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:26.342476 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-665586dff6-bjp7f"] Jun 10 01:13:26.344805 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:13:26.344778 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6599dfcc_952a_48fe_9b8a_10d26d7865c7.slice/crio-dc66b9c6e98213c2c96069d9af6dbe3e9fa9d538690b27f4ee431cfc9ba6cf46 WatchSource:0}: Error finding container dc66b9c6e98213c2c96069d9af6dbe3e9fa9d538690b27f4ee431cfc9ba6cf46: Status 404 returned error can't find the container with id dc66b9c6e98213c2c96069d9af6dbe3e9fa9d538690b27f4ee431cfc9ba6cf46 Jun 10 01:13:27.008521 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:27.008484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-665586dff6-bjp7f" event={"ID":"6599dfcc-952a-48fe-9b8a-10d26d7865c7","Type":"ContainerStarted","Data":"dc66b9c6e98213c2c96069d9af6dbe3e9fa9d538690b27f4ee431cfc9ba6cf46"} Jun 10 01:13:27.010427 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:27.010312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-746d97f49b-xf7sq" event={"ID":"a7802fce-25c9-4514-8954-cffec74a799e","Type":"ContainerStarted","Data":"4ab58c5602b0b938d2523fd11114eb39f433c3e1e82fad55ffbe7d13f7223a71"} Jun 10 01:13:28.941620 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:28.941541 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:29.023520 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.023473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-665586dff6-bjp7f" event={"ID":"6599dfcc-952a-48fe-9b8a-10d26d7865c7","Type":"ContainerStarted","Data":"63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83"} Jun 10 01:13:29.023706 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.023552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:29.027104 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.027070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-746d97f49b-xf7sq" event={"ID":"a7802fce-25c9-4514-8954-cffec74a799e","Type":"ContainerStarted","Data":"171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06"} Jun 10 01:13:29.027654 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.027625 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:29.038856 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.038819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:13:29.056185 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.056047 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-665586dff6-bjp7f" podStartSLOduration=1.7457830699999999 podStartE2EDuration="4.056026261s" totalImagesPullingTime="2.310243191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:29.055410656 +0000 UTC m=+749.632761781" watchObservedRunningTime="2026-06-10 01:13:29.056026261 +0000 UTC m=+749.633377387" Jun 10 01:13:29.077132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:29.077075 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-746d97f49b-xf7sq" podStartSLOduration=1.517900353 podStartE2EDuration="4.077057992s" totalImagesPullingTime="2.559157639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:29.076213308 +0000 UTC m=+749.653564460" watchObservedRunningTime="2026-06-10 01:13:29.077057992 +0000 UTC m=+749.654409117" Jun 10 01:13:40.037072 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.037043 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:13:40.037540 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.037369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:40.089332 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.089302 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-746d97f49b-xf7sq"] Jun 10 01:13:40.089532 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.089506 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-746d97f49b-xf7sq" podUID="a7802fce-25c9-4514-8954-cffec74a799e" containerName="manager" containerID="cri-o://171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06" gracePeriod=30 Jun 10 01:13:40.340630 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.340603 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:40.419539 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.419494 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7802fce-25c9-4514-8954-cffec74a799e-webhook-cert\") pod \"a7802fce-25c9-4514-8954-cffec74a799e\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " Jun 10 01:13:40.419711 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.419593 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zphnd\" (UniqueName: \"kubernetes.io/projected/a7802fce-25c9-4514-8954-cffec74a799e-kube-api-access-zphnd\") pod \"a7802fce-25c9-4514-8954-cffec74a799e\" (UID: \"a7802fce-25c9-4514-8954-cffec74a799e\") " Jun 10 01:13:40.421953 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.421922 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7802fce-25c9-4514-8954-cffec74a799e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7802fce-25c9-4514-8954-cffec74a799e" (UID: "a7802fce-25c9-4514-8954-cffec74a799e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:13:40.422075 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.421956 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7802fce-25c9-4514-8954-cffec74a799e-kube-api-access-zphnd" (OuterVolumeSpecName: "kube-api-access-zphnd") pod "a7802fce-25c9-4514-8954-cffec74a799e" (UID: "a7802fce-25c9-4514-8954-cffec74a799e"). InnerVolumeSpecName "kube-api-access-zphnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:40.520662 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.520620 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7802fce-25c9-4514-8954-cffec74a799e-webhook-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:13:40.520662 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:40.520654 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zphnd\" (UniqueName: \"kubernetes.io/projected/a7802fce-25c9-4514-8954-cffec74a799e-kube-api-access-zphnd\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:13:41.084640 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.084606 2565 generic.go:356] "Generic (PLEG): container finished" podID="a7802fce-25c9-4514-8954-cffec74a799e" containerID="171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06" exitCode=0 Jun 10 01:13:41.085095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.084646 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-746d97f49b-xf7sq" Jun 10 01:13:41.085095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.084653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-746d97f49b-xf7sq" event={"ID":"a7802fce-25c9-4514-8954-cffec74a799e","Type":"ContainerDied","Data":"171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06"} Jun 10 01:13:41.085095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.084694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-746d97f49b-xf7sq" event={"ID":"a7802fce-25c9-4514-8954-cffec74a799e","Type":"ContainerDied","Data":"4ab58c5602b0b938d2523fd11114eb39f433c3e1e82fad55ffbe7d13f7223a71"} Jun 10 01:13:41.085095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.084716 2565 scope.go:117] "RemoveContainer" containerID="171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06" Jun 10 01:13:41.093685 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.093530 2565 scope.go:117] "RemoveContainer" containerID="171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06" Jun 10 01:13:41.093823 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:13:41.093803 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06\": container with ID starting with 171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06 not found: ID does not exist" containerID="171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06" Jun 10 01:13:41.093886 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.093832 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06"} err="failed to get container status \"171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06\": rpc error: code = NotFound desc = could not find container \"171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06\": container with ID starting with 171137f21a931b9d8309171dd5c159c3b865746e868287fbe1971e4bf7f4fe06 not found: ID does not exist" Jun 10 01:13:41.105384 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.105346 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-746d97f49b-xf7sq"] Jun 10 01:13:41.108996 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.108967 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-746d97f49b-xf7sq"] Jun 10 01:13:41.877315 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:13:41.877283 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7802fce-25c9-4514-8954-cffec74a799e" path="/var/lib/kubelet/pods/a7802fce-25c9-4514-8954-cffec74a799e/volumes" Jun 10 01:14:00.083721 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.083653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:00.132231 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.132194 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-cc657986f-cstcq"] Jun 10 01:14:00.132564 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.132551 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7802fce-25c9-4514-8954-cffec74a799e" containerName="manager" Jun 10 01:14:00.132607 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.132567 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7802fce-25c9-4514-8954-cffec74a799e" containerName="manager" Jun 10 01:14:00.132641 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.132631 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7802fce-25c9-4514-8954-cffec74a799e" containerName="manager" Jun 10 01:14:00.136644 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.136622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.142646 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.142625 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ss7nm\"" Jun 10 01:14:00.143688 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.143664 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 01:14:00.150531 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.150471 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cc657986f-cstcq"] Jun 10 01:14:00.181218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.181184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:00.194299 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.194256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d074eb3-4dda-4b95-9939-c92a6398ed59-maas-api-tls\") pod \"maas-api-cc657986f-cstcq\" (UID: \"4d074eb3-4dda-4b95-9939-c92a6398ed59\") " pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.194458 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.194387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcsd\" (UniqueName: \"kubernetes.io/projected/4d074eb3-4dda-4b95-9939-c92a6398ed59-kube-api-access-wkcsd\") pod \"maas-api-cc657986f-cstcq\" (UID: \"4d074eb3-4dda-4b95-9939-c92a6398ed59\") " pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.295825 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.295771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcsd\" (UniqueName: \"kubernetes.io/projected/4d074eb3-4dda-4b95-9939-c92a6398ed59-kube-api-access-wkcsd\") pod \"maas-api-cc657986f-cstcq\" (UID: \"4d074eb3-4dda-4b95-9939-c92a6398ed59\") " pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.296032 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.295842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d074eb3-4dda-4b95-9939-c92a6398ed59-maas-api-tls\") pod \"maas-api-cc657986f-cstcq\" (UID: \"4d074eb3-4dda-4b95-9939-c92a6398ed59\") " pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.298510 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.298485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d074eb3-4dda-4b95-9939-c92a6398ed59-maas-api-tls\") pod \"maas-api-cc657986f-cstcq\" (UID: \"4d074eb3-4dda-4b95-9939-c92a6398ed59\") " pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.304225 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.304202 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcsd\" (UniqueName: \"kubernetes.io/projected/4d074eb3-4dda-4b95-9939-c92a6398ed59-kube-api-access-wkcsd\") pod \"maas-api-cc657986f-cstcq\" (UID: \"4d074eb3-4dda-4b95-9939-c92a6398ed59\") " pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.447453 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.447419 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:00.491335 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.491307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:00.582069 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.582033 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-bmzqq"] Jun 10 01:14:00.586442 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.586421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:00.589256 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.589234 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 01:14:00.601036 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.601009 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-bmzqq"] Jun 10 01:14:00.602904 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.602857 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cc657986f-cstcq"] Jun 10 01:14:00.603642 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:14:00.603617 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d074eb3_4dda_4b95_9939_c92a6398ed59.slice/crio-07eced28ed524e167cfa59fa1e843b7e906af08f36d5e63a17ba5ab49d9c3c14 WatchSource:0}: Error finding container 07eced28ed524e167cfa59fa1e843b7e906af08f36d5e63a17ba5ab49d9c3c14: Status 404 returned error can't find the container with id 07eced28ed524e167cfa59fa1e843b7e906af08f36d5e63a17ba5ab49d9c3c14 Jun 10 01:14:00.605565 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.605542 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:14:00.608228 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.608201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:00.649027 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.648994 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fcpk8"] Jun 10 01:14:00.652513 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.652494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:00.657042 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.657021 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-22574\"" Jun 10 01:14:00.664530 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.664506 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fcpk8"] Jun 10 01:14:00.699695 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.699610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2j4z\" (UniqueName: \"kubernetes.io/projected/869d2f33-cd96-4b28-a123-0b44b99bceb3-kube-api-access-n2j4z\") pod \"payload-pre-processing-579785bc64-bmzqq\" (UID: \"869d2f33-cd96-4b28-a123-0b44b99bceb3\") " pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:00.800946 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.800905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8wr\" (UniqueName: \"kubernetes.io/projected/714651f8-ef82-47a4-977b-cc5cab632cd4-kube-api-access-wv8wr\") pod \"payload-processing-699b6cd6c-fcpk8\" (UID: \"714651f8-ef82-47a4-977b-cc5cab632cd4\") " pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:00.801128 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.801031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2j4z\" (UniqueName: \"kubernetes.io/projected/869d2f33-cd96-4b28-a123-0b44b99bceb3-kube-api-access-n2j4z\") pod \"payload-pre-processing-579785bc64-bmzqq\" (UID: \"869d2f33-cd96-4b28-a123-0b44b99bceb3\") " pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:00.809587 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.809556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2j4z\" (UniqueName: \"kubernetes.io/projected/869d2f33-cd96-4b28-a123-0b44b99bceb3-kube-api-access-n2j4z\") pod \"payload-pre-processing-579785bc64-bmzqq\" (UID: \"869d2f33-cd96-4b28-a123-0b44b99bceb3\") " pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:00.900798 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.900761 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:00.901529 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.901508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8wr\" (UniqueName: \"kubernetes.io/projected/714651f8-ef82-47a4-977b-cc5cab632cd4-kube-api-access-wv8wr\") pod \"payload-processing-699b6cd6c-fcpk8\" (UID: \"714651f8-ef82-47a4-977b-cc5cab632cd4\") " pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:00.909843 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.909819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8wr\" (UniqueName: \"kubernetes.io/projected/714651f8-ef82-47a4-977b-cc5cab632cd4-kube-api-access-wv8wr\") pod \"payload-processing-699b6cd6c-fcpk8\" (UID: \"714651f8-ef82-47a4-977b-cc5cab632cd4\") " pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:00.963925 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:00.963895 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:01.051363 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:01.051335 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-bmzqq"] Jun 10 01:14:01.053347 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:14:01.053311 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869d2f33_cd96_4b28_a123_0b44b99bceb3.slice/crio-39ef988ab4f445cdf3b6abc4d571a87a9b36f9d6c61d9195068844f953fb0913 WatchSource:0}: Error finding container 39ef988ab4f445cdf3b6abc4d571a87a9b36f9d6c61d9195068844f953fb0913: Status 404 returned error can't find the container with id 39ef988ab4f445cdf3b6abc4d571a87a9b36f9d6c61d9195068844f953fb0913 Jun 10 01:14:01.114433 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:01.114399 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fcpk8"] Jun 10 01:14:01.117821 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:14:01.117792 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714651f8_ef82_47a4_977b_cc5cab632cd4.slice/crio-5913cecf09af8ab0c988cb8b9f47ad0e401510065f661825565e48c68aac0573 WatchSource:0}: Error finding container 5913cecf09af8ab0c988cb8b9f47ad0e401510065f661825565e48c68aac0573: Status 404 returned error can't find the container with id 5913cecf09af8ab0c988cb8b9f47ad0e401510065f661825565e48c68aac0573 Jun 10 01:14:01.181218 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:01.181183 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" event={"ID":"869d2f33-cd96-4b28-a123-0b44b99bceb3","Type":"ContainerStarted","Data":"39ef988ab4f445cdf3b6abc4d571a87a9b36f9d6c61d9195068844f953fb0913"} Jun 10 01:14:01.182550 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:01.182515 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" event={"ID":"714651f8-ef82-47a4-977b-cc5cab632cd4","Type":"ContainerStarted","Data":"5913cecf09af8ab0c988cb8b9f47ad0e401510065f661825565e48c68aac0573"} Jun 10 01:14:01.183764 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:01.183738 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cc657986f-cstcq" event={"ID":"4d074eb3-4dda-4b95-9939-c92a6398ed59","Type":"ContainerStarted","Data":"07eced28ed524e167cfa59fa1e843b7e906af08f36d5e63a17ba5ab49d9c3c14"} Jun 10 01:14:04.216612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.216560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cc657986f-cstcq" event={"ID":"4d074eb3-4dda-4b95-9939-c92a6398ed59","Type":"ContainerStarted","Data":"3157598932ac72703ec1b906635edc9bd416874f6ea0df6ddac5787da9a61be8"} Jun 10 01:14:04.217095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.216633 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:04.218204 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.218179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" event={"ID":"869d2f33-cd96-4b28-a123-0b44b99bceb3","Type":"ContainerStarted","Data":"b8db31d5b9102762af1d135ad444524603f5920d34d5a379b88e33f649c8e99c"} Jun 10 01:14:04.218332 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.218232 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:04.219671 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.219645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" event={"ID":"714651f8-ef82-47a4-977b-cc5cab632cd4","Type":"ContainerStarted","Data":"789fe71697d596404da42ffa2eb5fb9aa6d1318188100aa49d5a287aa9bb346d"} Jun 10 01:14:04.219820 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.219785 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:04.236041 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.235988 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-cc657986f-cstcq" podStartSLOduration=1.223359731 podStartE2EDuration="4.235973558s" totalImagesPullingTime="3.012613827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:04.233819324 +0000 UTC m=+784.811170463" watchObservedRunningTime="2026-06-10 01:14:04.235973558 +0000 UTC m=+784.813324683" Jun 10 01:14:04.249956 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.249907 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" podStartSLOduration=1.620643777 podStartE2EDuration="4.249892272s" totalImagesPullingTime="2.629248495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:04.247986586 +0000 UTC m=+784.825337737" watchObservedRunningTime="2026-06-10 01:14:04.249892272 +0000 UTC m=+784.827243389" Jun 10 01:14:04.263418 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:04.263364 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" podStartSLOduration=1.691787958 podStartE2EDuration="4.263346653s" totalImagesPullingTime="2.571558695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:04.26186391 +0000 UTC m=+784.839215055" watchObservedRunningTime="2026-06-10 01:14:04.263346653 +0000 UTC m=+784.840697779" Jun 10 01:14:10.230283 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:10.230254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-cc657986f-cstcq" Jun 10 01:14:12.267592 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:12.267551 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:14:12.268050 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:12.267792 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" containerID="cri-o://1a8fac5735c6060f0839c20d49ab7e08f9228bafb3960f836774c7e79f738da0" gracePeriod=30 Jun 10 01:14:14.270040 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:14.270007 2565 generic.go:356] "Generic (PLEG): container finished" podID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerID="1a8fac5735c6060f0839c20d49ab7e08f9228bafb3960f836774c7e79f738da0" exitCode=143 Jun 10 01:14:14.270407 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:14.270082 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e099ef07-cebd-4857-9fea-d6a2bfbed154","Type":"ContainerDied","Data":"1a8fac5735c6060f0839c20d49ab7e08f9228bafb3960f836774c7e79f738da0"} Jun 10 01:14:14.344306 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:14.344279 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:14.537976 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:14.537938 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwsxl\" (UniqueName: \"kubernetes.io/projected/e099ef07-cebd-4857-9fea-d6a2bfbed154-kube-api-access-dwsxl\") pod \"e099ef07-cebd-4857-9fea-d6a2bfbed154\" (UID: \"e099ef07-cebd-4857-9fea-d6a2bfbed154\") " Jun 10 01:14:14.540411 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:14.540371 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e099ef07-cebd-4857-9fea-d6a2bfbed154-kube-api-access-dwsxl" (OuterVolumeSpecName: "kube-api-access-dwsxl") pod "e099ef07-cebd-4857-9fea-d6a2bfbed154" (UID: "e099ef07-cebd-4857-9fea-d6a2bfbed154"). InnerVolumeSpecName "kube-api-access-dwsxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:14:14.638789 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:14.638747 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwsxl\" (UniqueName: \"kubernetes.io/projected/e099ef07-cebd-4857-9fea-d6a2bfbed154-kube-api-access-dwsxl\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:14:15.227648 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.227617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-fcpk8" Jun 10 01:14:15.227817 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.227686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-bmzqq" Jun 10 01:14:15.276907 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.276843 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.277367 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.276847 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e099ef07-cebd-4857-9fea-d6a2bfbed154","Type":"ContainerDied","Data":"009e535a9d8848fda014e0e13d3a66ea908aed20861d760582f1bd031bb71d6e"} Jun 10 01:14:15.277367 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.277002 2565 scope.go:117] "RemoveContainer" containerID="1a8fac5735c6060f0839c20d49ab7e08f9228bafb3960f836774c7e79f738da0" Jun 10 01:14:15.302635 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.302564 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:14:15.310127 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.310095 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:14:15.332470 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.332436 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:14:15.332933 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.332914 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" Jun 10 01:14:15.333035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.332935 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" Jun 10 01:14:15.333035 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.333022 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" containerName="keycloak" Jun 10 01:14:15.337517 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.337491 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.339958 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.339935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6vtmw\"" Jun 10 01:14:15.340083 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.339935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 01:14:15.340083 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.340016 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 01:14:15.340179 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.340115 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 01:14:15.340233 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.340217 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 01:14:15.345787 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.345759 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmsgj\" (UniqueName: \"kubernetes.io/projected/b85966d8-f850-408e-992e-e3fa7fe580b5-kube-api-access-tmsgj\") pod \"maas-keycloak-0\" (UID: \"b85966d8-f850-408e-992e-e3fa7fe580b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.345989 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.345969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b85966d8-f850-408e-992e-e3fa7fe580b5-test-realms\") pod \"maas-keycloak-0\" (UID: \"b85966d8-f850-408e-992e-e3fa7fe580b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.347383 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.347358 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:14:15.446891 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.446852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmsgj\" (UniqueName: \"kubernetes.io/projected/b85966d8-f850-408e-992e-e3fa7fe580b5-kube-api-access-tmsgj\") pod \"maas-keycloak-0\" (UID: \"b85966d8-f850-408e-992e-e3fa7fe580b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.447073 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.446928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b85966d8-f850-408e-992e-e3fa7fe580b5-test-realms\") pod \"maas-keycloak-0\" (UID: \"b85966d8-f850-408e-992e-e3fa7fe580b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.447619 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.447597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b85966d8-f850-408e-992e-e3fa7fe580b5-test-realms\") pod \"maas-keycloak-0\" (UID: \"b85966d8-f850-408e-992e-e3fa7fe580b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.457670 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.457632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmsgj\" (UniqueName: \"kubernetes.io/projected/b85966d8-f850-408e-992e-e3fa7fe580b5-kube-api-access-tmsgj\") pod \"maas-keycloak-0\" (UID: \"b85966d8-f850-408e-992e-e3fa7fe580b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.648164 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.648074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:15.785500 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.785471 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:14:15.787959 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:14:15.787930 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85966d8_f850_408e_992e_e3fa7fe580b5.slice/crio-33f61e48b8891b997187190a61fad51d3e70b5a7eef6de68992ba4240dcf2726 WatchSource:0}: Error finding container 33f61e48b8891b997187190a61fad51d3e70b5a7eef6de68992ba4240dcf2726: Status 404 returned error can't find the container with id 33f61e48b8891b997187190a61fad51d3e70b5a7eef6de68992ba4240dcf2726 Jun 10 01:14:15.878040 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:15.878005 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e099ef07-cebd-4857-9fea-d6a2bfbed154" path="/var/lib/kubelet/pods/e099ef07-cebd-4857-9fea-d6a2bfbed154/volumes" Jun 10 01:14:16.283617 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:16.283575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b85966d8-f850-408e-992e-e3fa7fe580b5","Type":"ContainerStarted","Data":"5eff966790814be501c25ae6ba7020aa27fbc48abd1d7b56ba22f02d3060d45a"} Jun 10 01:14:16.284096 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:16.283643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b85966d8-f850-408e-992e-e3fa7fe580b5","Type":"ContainerStarted","Data":"33f61e48b8891b997187190a61fad51d3e70b5a7eef6de68992ba4240dcf2726"} Jun 10 01:14:16.302380 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:16.302316 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.946507277 podStartE2EDuration="1.30229313s" totalImagesPullingTime="355.785853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:16.301154234 +0000 UTC m=+796.878505381" watchObservedRunningTime="2026-06-10 01:14:16.30229313 +0000 UTC m=+796.879644256" Jun 10 01:14:16.649192 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:16.649147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:16.651156 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:16.651112 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:17.649488 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:17.649437 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:18.649118 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:18.649066 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:19.648731 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:19.648675 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:20.649060 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:20.649005 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:21.648533 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:21.648475 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:22.648636 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:22.648578 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:23.648802 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:23.648755 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:24.648602 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:24.648539 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:25.648767 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:25.648722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:25.649290 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:25.649139 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:26.648984 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:26.648923 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:27.648759 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:27.648705 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:28.649072 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:28.649022 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.39:9000/health/started\": dial tcp 10.134.0.39:9000: connect: connection refused" Jun 10 01:14:29.761320 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:29.761275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:29.783132 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:29.783079 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b85966d8-f850-408e-992e-e3fa7fe580b5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:14:39.767598 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:39.767559 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:14:50.458442 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.458409 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b966f94f-69t99"] Jun 10 01:14:50.460946 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.460923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.463409 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.463385 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 01:14:50.469410 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.469386 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b966f94f-69t99"] Jun 10 01:14:50.587290 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.587248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1b2d2b0-69a2-4159-870b-86a62d8d045a-tls-cert\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.587290 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.587287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1b2d2b0-69a2-4159-870b-86a62d8d045a-oidc-ca\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.587528 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.587324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpr86\" (UniqueName: \"kubernetes.io/projected/d1b2d2b0-69a2-4159-870b-86a62d8d045a-kube-api-access-dpr86\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.688267 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.688222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpr86\" (UniqueName: \"kubernetes.io/projected/d1b2d2b0-69a2-4159-870b-86a62d8d045a-kube-api-access-dpr86\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.688434 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.688320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1b2d2b0-69a2-4159-870b-86a62d8d045a-tls-cert\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.688434 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.688337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1b2d2b0-69a2-4159-870b-86a62d8d045a-oidc-ca\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.688942 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.688916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1b2d2b0-69a2-4159-870b-86a62d8d045a-oidc-ca\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.691016 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.690989 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1b2d2b0-69a2-4159-870b-86a62d8d045a-tls-cert\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.695788 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.695765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpr86\" (UniqueName: \"kubernetes.io/projected/d1b2d2b0-69a2-4159-870b-86a62d8d045a-kube-api-access-dpr86\") pod \"authorino-7b966f94f-69t99\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.771889 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.771785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:14:50.904951 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:50.904921 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b966f94f-69t99"] Jun 10 01:14:50.907234 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:14:50.907203 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1b2d2b0_69a2_4159_870b_86a62d8d045a.slice/crio-933a7c6168c7a5d98fe3ab3e75b9423107c5cfae24668e8529b19c6360cbe8e1 WatchSource:0}: Error finding container 933a7c6168c7a5d98fe3ab3e75b9423107c5cfae24668e8529b19c6360cbe8e1: Status 404 returned error can't find the container with id 933a7c6168c7a5d98fe3ab3e75b9423107c5cfae24668e8529b19c6360cbe8e1 Jun 10 01:14:51.506259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:51.506161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b966f94f-69t99" event={"ID":"d1b2d2b0-69a2-4159-870b-86a62d8d045a","Type":"ContainerStarted","Data":"e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6"} Jun 10 01:14:51.506259 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:51.506215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b966f94f-69t99" event={"ID":"d1b2d2b0-69a2-4159-870b-86a62d8d045a","Type":"ContainerStarted","Data":"933a7c6168c7a5d98fe3ab3e75b9423107c5cfae24668e8529b19c6360cbe8e1"} Jun 10 01:14:51.523200 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:51.523131 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b966f94f-69t99" podStartSLOduration=1.214850836 podStartE2EDuration="1.523093889s" totalImagesPullingTime="308.243053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:51.52055005 +0000 UTC m=+832.097901176" watchObservedRunningTime="2026-06-10 01:14:51.523093889 +0000 UTC m=+832.100445015" Jun 10 01:14:51.548971 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:51.548867 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5565d8b64f-zfpcz"] Jun 10 01:14:51.549453 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:51.549420 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" podUID="ff668094-f2f3-438c-9668-319f4a4d6062" containerName="authorino" containerID="cri-o://8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0" gracePeriod=30 Jun 10 01:14:51.832577 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:51.832550 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:14:52.002119 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.002085 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff668094-f2f3-438c-9668-319f4a4d6062-tls-cert\") pod \"ff668094-f2f3-438c-9668-319f4a4d6062\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " Jun 10 01:14:52.002323 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.002157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttk4q\" (UniqueName: \"kubernetes.io/projected/ff668094-f2f3-438c-9668-319f4a4d6062-kube-api-access-ttk4q\") pod \"ff668094-f2f3-438c-9668-319f4a4d6062\" (UID: \"ff668094-f2f3-438c-9668-319f4a4d6062\") " Jun 10 01:14:52.004270 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.004238 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff668094-f2f3-438c-9668-319f4a4d6062-kube-api-access-ttk4q" (OuterVolumeSpecName: "kube-api-access-ttk4q") pod "ff668094-f2f3-438c-9668-319f4a4d6062" (UID: "ff668094-f2f3-438c-9668-319f4a4d6062"). InnerVolumeSpecName "kube-api-access-ttk4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:14:52.012611 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.012584 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff668094-f2f3-438c-9668-319f4a4d6062-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ff668094-f2f3-438c-9668-319f4a4d6062" (UID: "ff668094-f2f3-438c-9668-319f4a4d6062"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:14:52.102845 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.102764 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff668094-f2f3-438c-9668-319f4a4d6062-tls-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:14:52.102845 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.102794 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttk4q\" (UniqueName: \"kubernetes.io/projected/ff668094-f2f3-438c-9668-319f4a4d6062-kube-api-access-ttk4q\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:14:52.153340 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.153303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:52.276963 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.276913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:14:52.512172 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.512136 2565 generic.go:356] "Generic (PLEG): container finished" podID="ff668094-f2f3-438c-9668-319f4a4d6062" containerID="8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0" exitCode=0 Jun 10 01:14:52.512734 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.512187 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" Jun 10 01:14:52.512734 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.512221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" event={"ID":"ff668094-f2f3-438c-9668-319f4a4d6062","Type":"ContainerDied","Data":"8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0"} Jun 10 01:14:52.512734 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.512260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5565d8b64f-zfpcz" event={"ID":"ff668094-f2f3-438c-9668-319f4a4d6062","Type":"ContainerDied","Data":"5d9e7d59bce24911e6420917f70ba4265621ccc988e2070472cb9662d4af444b"} Jun 10 01:14:52.512734 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.512276 2565 scope.go:117] "RemoveContainer" containerID="8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0" Jun 10 01:14:52.521026 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.521008 2565 scope.go:117] "RemoveContainer" containerID="8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0" Jun 10 01:14:52.521281 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:14:52.521262 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0\": container with ID starting with 8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0 not found: ID does not exist" containerID="8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0" Jun 10 01:14:52.521348 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.521293 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0"} err="failed to get container status \"8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0\": rpc error: code = NotFound desc = could not find container \"8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0\": container with ID starting with 8d4064b24f8c666a6bc1b178bc1ccc018977cb59ed72aa4f7a4a6e20896187a0 not found: ID does not exist" Jun 10 01:14:52.532669 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.532646 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5565d8b64f-zfpcz"] Jun 10 01:14:52.535653 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:52.535631 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5565d8b64f-zfpcz"] Jun 10 01:14:53.877722 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:14:53.877687 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff668094-f2f3-438c-9668-319f4a4d6062" path="/var/lib/kubelet/pods/ff668094-f2f3-438c-9668-319f4a4d6062/volumes" Jun 10 01:15:01.440604 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:01.440559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:07.595487 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.595450 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc"] Jun 10 01:15:07.595943 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.595913 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff668094-f2f3-438c-9668-319f4a4d6062" containerName="authorino" Jun 10 01:15:07.595943 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.595930 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff668094-f2f3-438c-9668-319f4a4d6062" containerName="authorino" Jun 10 01:15:07.596079 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.595994 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff668094-f2f3-438c-9668-319f4a4d6062" containerName="authorino" Jun 10 01:15:07.599269 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.599249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.601737 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.601715 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 01:15:07.602811 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.602785 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5ql7f\"" Jun 10 01:15:07.602948 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.602840 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 01:15:07.602948 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.602842 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 01:15:07.609147 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.609121 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc"] Jun 10 01:15:07.634430 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.634390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.634616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.634437 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.634616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.634473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x44vm\" (UniqueName: \"kubernetes.io/projected/7ef139ce-be06-47c3-a543-c8a992b3541d-kube-api-access-x44vm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.634616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.634502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.634616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.634524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef139ce-be06-47c3-a543-c8a992b3541d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.634616 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.634558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.735815 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.735777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.735815 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.735815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.735835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x44vm\" (UniqueName: \"kubernetes.io/projected/7ef139ce-be06-47c3-a543-c8a992b3541d-kube-api-access-x44vm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.735853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.735871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef139ce-be06-47c3-a543-c8a992b3541d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736094 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.735950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736310 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.736208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736310 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.736271 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.736382 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.736359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.738533 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.738507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef139ce-be06-47c3-a543-c8a992b3541d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.738776 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.738753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef139ce-be06-47c3-a543-c8a992b3541d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.744754 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.744724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x44vm\" (UniqueName: \"kubernetes.io/projected/7ef139ce-be06-47c3-a543-c8a992b3541d-kube-api-access-x44vm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rlpdc\" (UID: \"7ef139ce-be06-47c3-a543-c8a992b3541d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:07.781251 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.781215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:07.910291 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:07.910209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:08.047311 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:08.047285 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc"] Jun 10 01:15:08.049235 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:15:08.049208 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef139ce_be06_47c3_a543_c8a992b3541d.slice/crio-8259e9904d9aa955fcbb4faadedb47a92e1ac11d47ede76764bd17a49b789e01 WatchSource:0}: Error finding container 8259e9904d9aa955fcbb4faadedb47a92e1ac11d47ede76764bd17a49b789e01: Status 404 returned error can't find the container with id 8259e9904d9aa955fcbb4faadedb47a92e1ac11d47ede76764bd17a49b789e01 Jun 10 01:15:08.593203 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:08.593165 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" event={"ID":"7ef139ce-be06-47c3-a543-c8a992b3541d","Type":"ContainerStarted","Data":"8259e9904d9aa955fcbb4faadedb47a92e1ac11d47ede76764bd17a49b789e01"} Jun 10 01:15:12.614019 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:12.613975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" event={"ID":"7ef139ce-be06-47c3-a543-c8a992b3541d","Type":"ContainerStarted","Data":"46c1160dc71f54c5b3efea8aaa6af5193a3fae6fc026a33f79b3dbcddf83691d"} Jun 10 01:15:15.631418 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:15.631379 2565 generic.go:356] "Generic (PLEG): container finished" podID="7ef139ce-be06-47c3-a543-c8a992b3541d" containerID="46c1160dc71f54c5b3efea8aaa6af5193a3fae6fc026a33f79b3dbcddf83691d" exitCode=0 Jun 10 01:15:15.631811 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:15.631454 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" event={"ID":"7ef139ce-be06-47c3-a543-c8a992b3541d","Type":"ContainerDied","Data":"46c1160dc71f54c5b3efea8aaa6af5193a3fae6fc026a33f79b3dbcddf83691d"} Jun 10 01:15:17.643234 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:17.643200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" event={"ID":"7ef139ce-be06-47c3-a543-c8a992b3541d","Type":"ContainerStarted","Data":"7610fb2bc41ce3860145eefa430961181717b1261683e89ae17c691fcfc79952"} Jun 10 01:15:17.662326 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:17.662272 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" podStartSLOduration=2.840138245 podStartE2EDuration="10.662252774s" totalImagesPullingTime="5.148654887s" totalInitContainerRuntime="2.673459642s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:17.661029426 +0000 UTC m=+858.238380566" watchObservedRunningTime="2026-06-10 01:15:17.662252774 +0000 UTC m=+858.239603899" Jun 10 01:15:17.911082 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:17.910985 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:17.911082 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:17.911060 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:17.923614 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:17.923584 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:18.659428 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:18.659397 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rlpdc" Jun 10 01:15:20.776108 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:20.776065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:30.726006 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:30.725971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:41.551612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:41.551562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:41.601851 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:41.601809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:51.903493 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.903455 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47"] Jun 10 01:15:51.910692 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.910670 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:51.913061 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.913039 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 01:15:51.922121 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.922097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47"] Jun 10 01:15:51.926125 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.926093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:51.941682 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.941650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:51.941682 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.941681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnwp\" (UniqueName: \"kubernetes.io/projected/1ce770b5-8806-4598-8e5e-41e79d3064bf-kube-api-access-lfnwp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:51.941860 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.941716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:51.941860 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.941825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:51.941860 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.941858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce770b5-8806-4598-8e5e-41e79d3064bf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:51.941994 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:51.941922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043003 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.042966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043191 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043191 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce770b5-8806-4598-8e5e-41e79d3064bf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043191 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043191 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043191 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnwp\" (UniqueName: \"kubernetes.io/projected/1ce770b5-8806-4598-8e5e-41e79d3064bf-kube-api-access-lfnwp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043496 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.043655 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.043616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.045669 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.045650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce770b5-8806-4598-8e5e-41e79d3064bf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.045837 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.045821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce770b5-8806-4598-8e5e-41e79d3064bf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.051296 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.051275 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnwp\" (UniqueName: \"kubernetes.io/projected/1ce770b5-8806-4598-8e5e-41e79d3064bf-kube-api-access-lfnwp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kkp47\" (UID: \"1ce770b5-8806-4598-8e5e-41e79d3064bf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.222402 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.222364 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:15:52.364683 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.364655 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47"] Jun 10 01:15:52.366975 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:15:52.366945 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce770b5_8806_4598_8e5e_41e79d3064bf.slice/crio-6e7a7fee5c4102411b858b55d98dfe2668c1450e9f0eb430a1a1d8334f8ed56f WatchSource:0}: Error finding container 6e7a7fee5c4102411b858b55d98dfe2668c1450e9f0eb430a1a1d8334f8ed56f: Status 404 returned error can't find the container with id 6e7a7fee5c4102411b858b55d98dfe2668c1450e9f0eb430a1a1d8334f8ed56f Jun 10 01:15:52.826469 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.826427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" event={"ID":"1ce770b5-8806-4598-8e5e-41e79d3064bf","Type":"ContainerStarted","Data":"c0abcc0827e7b2c5d58a4694cdda9bcafebbef594aa4e7a6554405093f769f93"} Jun 10 01:15:52.826666 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:52.826513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" event={"ID":"1ce770b5-8806-4598-8e5e-41e79d3064bf","Type":"ContainerStarted","Data":"6e7a7fee5c4102411b858b55d98dfe2668c1450e9f0eb430a1a1d8334f8ed56f"} Jun 10 01:15:54.838787 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:54.838753 2565 generic.go:356] "Generic (PLEG): container finished" podID="1ce770b5-8806-4598-8e5e-41e79d3064bf" containerID="c0abcc0827e7b2c5d58a4694cdda9bcafebbef594aa4e7a6554405093f769f93" exitCode=0 Jun 10 01:15:54.839219 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:54.838802 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" event={"ID":"1ce770b5-8806-4598-8e5e-41e79d3064bf","Type":"ContainerDied","Data":"c0abcc0827e7b2c5d58a4694cdda9bcafebbef594aa4e7a6554405093f769f93"} Jun 10 01:15:55.846201 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:55.846167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" event={"ID":"1ce770b5-8806-4598-8e5e-41e79d3064bf","Type":"ContainerStarted","Data":"c83ec8b86c417835d2d1788f9a89907dc1f42289a05214fd3db25b56063fb8c5"} Jun 10 01:15:55.863466 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:55.863405 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" podStartSLOduration=3.243123799 podStartE2EDuration="4.863387727s" totalImagesPullingTime="192.754807ms" totalInitContainerRuntime="1.427509121s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:55.862060553 +0000 UTC m=+896.439411699" watchObservedRunningTime="2026-06-10 01:15:55.863387727 +0000 UTC m=+896.440738853" Jun 10 01:15:59.884739 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:59.884711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:15:59.887456 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:15:59.887426 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:16:02.222866 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:16:02.222829 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:16:02.223480 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:16:02.222961 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:16:02.235514 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:16:02.235477 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:16:02.892550 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:16:02.892514 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kkp47" Jun 10 01:16:06.713007 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:16:06.712964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:03.296257 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.296185 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54f79987bd-wwtw6"] Jun 10 01:17:03.300130 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.300105 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.306724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.306695 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f79987bd-wwtw6"] Jun 10 01:17:03.396239 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.396200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k97w\" (UniqueName: \"kubernetes.io/projected/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-kube-api-access-2k97w\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.396419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.396256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-oidc-ca\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.396419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.396360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-tls-cert\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.497506 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.497471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-tls-cert\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.497685 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.497536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k97w\" (UniqueName: \"kubernetes.io/projected/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-kube-api-access-2k97w\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.497685 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.497568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-oidc-ca\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.498275 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.498255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-oidc-ca\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.500152 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.500135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-tls-cert\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.505805 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.505781 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k97w\" (UniqueName: \"kubernetes.io/projected/1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b-kube-api-access-2k97w\") pod \"authorino-54f79987bd-wwtw6\" (UID: \"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b\") " pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.611025 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.610911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f79987bd-wwtw6" Jun 10 01:17:03.748086 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:03.748011 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f79987bd-wwtw6"] Jun 10 01:17:03.750574 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:17:03.750544 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d18560a_e5f9_4ae4_ac17_ac53f63f2e4b.slice/crio-39586bbb89f3ca28d234a4bc93f9c059a2020655fe330157c9cb1e40e706bec7 WatchSource:0}: Error finding container 39586bbb89f3ca28d234a4bc93f9c059a2020655fe330157c9cb1e40e706bec7: Status 404 returned error can't find the container with id 39586bbb89f3ca28d234a4bc93f9c059a2020655fe330157c9cb1e40e706bec7 Jun 10 01:17:04.189317 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:04.189187 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f79987bd-wwtw6" event={"ID":"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b","Type":"ContainerStarted","Data":"39586bbb89f3ca28d234a4bc93f9c059a2020655fe330157c9cb1e40e706bec7"} Jun 10 01:17:05.196968 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.196926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f79987bd-wwtw6" event={"ID":"1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b","Type":"ContainerStarted","Data":"eab1d8bad1135daf320ee04ec29cabdde3bf9b3c4750d2079c47c8b8097735fe"} Jun 10 01:17:05.212814 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.212747 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54f79987bd-wwtw6" podStartSLOduration=1.8329655900000001 podStartE2EDuration="2.212725234s" totalImagesPullingTime="379.759644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:17:05.211313474 +0000 UTC m=+965.788664604" watchObservedRunningTime="2026-06-10 01:17:05.212725234 +0000 UTC m=+965.790076361" Jun 10 01:17:05.239973 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.239929 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b966f94f-69t99"] Jun 10 01:17:05.240171 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.240132 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b966f94f-69t99" podUID="d1b2d2b0-69a2-4159-870b-86a62d8d045a" containerName="authorino" containerID="cri-o://e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6" gracePeriod=30 Jun 10 01:17:05.512421 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.512389 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:17:05.620510 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.620473 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1b2d2b0-69a2-4159-870b-86a62d8d045a-tls-cert\") pod \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " Jun 10 01:17:05.620510 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.620515 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpr86\" (UniqueName: \"kubernetes.io/projected/d1b2d2b0-69a2-4159-870b-86a62d8d045a-kube-api-access-dpr86\") pod \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " Jun 10 01:17:05.620736 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.620540 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1b2d2b0-69a2-4159-870b-86a62d8d045a-oidc-ca\") pod \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\" (UID: \"d1b2d2b0-69a2-4159-870b-86a62d8d045a\") " Jun 10 01:17:05.622729 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.622696 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b2d2b0-69a2-4159-870b-86a62d8d045a-kube-api-access-dpr86" (OuterVolumeSpecName: "kube-api-access-dpr86") pod "d1b2d2b0-69a2-4159-870b-86a62d8d045a" (UID: "d1b2d2b0-69a2-4159-870b-86a62d8d045a"). InnerVolumeSpecName "kube-api-access-dpr86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:17:05.625653 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.625626 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1b2d2b0-69a2-4159-870b-86a62d8d045a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "d1b2d2b0-69a2-4159-870b-86a62d8d045a" (UID: "d1b2d2b0-69a2-4159-870b-86a62d8d045a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:17:05.631077 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.631053 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1b2d2b0-69a2-4159-870b-86a62d8d045a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d1b2d2b0-69a2-4159-870b-86a62d8d045a" (UID: "d1b2d2b0-69a2-4159-870b-86a62d8d045a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:17:05.721204 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.721170 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1b2d2b0-69a2-4159-870b-86a62d8d045a-tls-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:17:05.721204 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.721198 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpr86\" (UniqueName: \"kubernetes.io/projected/d1b2d2b0-69a2-4159-870b-86a62d8d045a-kube-api-access-dpr86\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:17:05.721204 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.721207 2565 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d1b2d2b0-69a2-4159-870b-86a62d8d045a-oidc-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:17:05.882766 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.882683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:05.971860 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:05.971827 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:06.203997 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.203957 2565 generic.go:356] "Generic (PLEG): container finished" podID="d1b2d2b0-69a2-4159-870b-86a62d8d045a" containerID="e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6" exitCode=0 Jun 10 01:17:06.204454 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.203998 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b966f94f-69t99" Jun 10 01:17:06.204454 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.204053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b966f94f-69t99" event={"ID":"d1b2d2b0-69a2-4159-870b-86a62d8d045a","Type":"ContainerDied","Data":"e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6"} Jun 10 01:17:06.204454 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.204088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b966f94f-69t99" event={"ID":"d1b2d2b0-69a2-4159-870b-86a62d8d045a","Type":"ContainerDied","Data":"933a7c6168c7a5d98fe3ab3e75b9423107c5cfae24668e8529b19c6360cbe8e1"} Jun 10 01:17:06.204454 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.204108 2565 scope.go:117] "RemoveContainer" containerID="e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6" Jun 10 01:17:06.213670 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.213651 2565 scope.go:117] "RemoveContainer" containerID="e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6" Jun 10 01:17:06.214020 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:17:06.213998 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6\": container with ID starting with e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6 not found: ID does not exist" containerID="e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6" Jun 10 01:17:06.214082 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.214033 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6"} err="failed to get container status \"e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6\": rpc error: code = NotFound desc = could not find container \"e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6\": container with ID starting with e55acd777531a376e2c8dd5bf0b0d6b292eed398e69c3c425571972335a505e6 not found: ID does not exist" Jun 10 01:17:06.219743 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.219719 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b966f94f-69t99"] Jun 10 01:17:06.223504 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.223484 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b966f94f-69t99"] Jun 10 01:17:06.940977 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:06.940938 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:07.038257 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:07.038221 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:07.877954 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:17:07.877920 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1b2d2b0-69a2-4159-870b-86a62d8d045a" path="/var/lib/kubelet/pods/d1b2d2b0-69a2-4159-870b-86a62d8d045a/volumes" Jun 10 01:18:33.975157 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:33.975105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:34.078114 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.078080 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-665586dff6-bjp7f"] Jun 10 01:18:34.078345 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.078315 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-665586dff6-bjp7f" podUID="6599dfcc-952a-48fe-9b8a-10d26d7865c7" containerName="manager" containerID="cri-o://63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83" gracePeriod=30 Jun 10 01:18:34.336269 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.336245 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:18:34.430423 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.430369 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6599dfcc-952a-48fe-9b8a-10d26d7865c7-webhook-cert\") pod \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " Jun 10 01:18:34.430599 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.430444 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt9ld\" (UniqueName: \"kubernetes.io/projected/6599dfcc-952a-48fe-9b8a-10d26d7865c7-kube-api-access-gt9ld\") pod \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\" (UID: \"6599dfcc-952a-48fe-9b8a-10d26d7865c7\") " Jun 10 01:18:34.432680 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.432650 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6599dfcc-952a-48fe-9b8a-10d26d7865c7-kube-api-access-gt9ld" (OuterVolumeSpecName: "kube-api-access-gt9ld") pod "6599dfcc-952a-48fe-9b8a-10d26d7865c7" (UID: "6599dfcc-952a-48fe-9b8a-10d26d7865c7"). InnerVolumeSpecName "kube-api-access-gt9ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:18:34.432744 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.432710 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6599dfcc-952a-48fe-9b8a-10d26d7865c7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6599dfcc-952a-48fe-9b8a-10d26d7865c7" (UID: "6599dfcc-952a-48fe-9b8a-10d26d7865c7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:18:34.531515 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.531424 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6599dfcc-952a-48fe-9b8a-10d26d7865c7-webhook-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:18:34.531515 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.531457 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt9ld\" (UniqueName: \"kubernetes.io/projected/6599dfcc-952a-48fe-9b8a-10d26d7865c7-kube-api-access-gt9ld\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 10 01:18:34.644556 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.644521 2565 generic.go:356] "Generic (PLEG): container finished" podID="6599dfcc-952a-48fe-9b8a-10d26d7865c7" containerID="63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83" exitCode=0 Jun 10 01:18:34.644724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.644571 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-665586dff6-bjp7f" Jun 10 01:18:34.644724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.644602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-665586dff6-bjp7f" event={"ID":"6599dfcc-952a-48fe-9b8a-10d26d7865c7","Type":"ContainerDied","Data":"63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83"} Jun 10 01:18:34.644724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.644651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-665586dff6-bjp7f" event={"ID":"6599dfcc-952a-48fe-9b8a-10d26d7865c7","Type":"ContainerDied","Data":"dc66b9c6e98213c2c96069d9af6dbe3e9fa9d538690b27f4ee431cfc9ba6cf46"} Jun 10 01:18:34.644724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.644672 2565 scope.go:117] "RemoveContainer" containerID="63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83" Jun 10 01:18:34.654103 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.654084 2565 scope.go:117] "RemoveContainer" containerID="63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83" Jun 10 01:18:34.654446 ip-10-0-131-207 kubenswrapper[2565]: E0610 01:18:34.654419 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83\": container with ID starting with 63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83 not found: ID does not exist" containerID="63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83" Jun 10 01:18:34.654543 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.654453 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83"} err="failed to get container status \"63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83\": rpc error: code = NotFound desc = could not find container \"63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83\": container with ID starting with 63e4156c02f1775d0913f5018a84125e87cc414df8a0e87b3d3ba9252ac69c83 not found: ID does not exist" Jun 10 01:18:34.665419 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.665388 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-665586dff6-bjp7f"] Jun 10 01:18:34.668227 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:34.668203 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-665586dff6-bjp7f"] Jun 10 01:18:35.294181 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.294148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:35.416826 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.416789 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-665586dff6-b2g9r"] Jun 10 01:18:35.417291 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.417273 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6599dfcc-952a-48fe-9b8a-10d26d7865c7" containerName="manager" Jun 10 01:18:35.417368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.417294 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6599dfcc-952a-48fe-9b8a-10d26d7865c7" containerName="manager" Jun 10 01:18:35.417368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.417307 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b2d2b0-69a2-4159-870b-86a62d8d045a" containerName="authorino" Jun 10 01:18:35.417368 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.417314 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b2d2b0-69a2-4159-870b-86a62d8d045a" containerName="authorino" Jun 10 01:18:35.417498 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.417372 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6599dfcc-952a-48fe-9b8a-10d26d7865c7" containerName="manager" Jun 10 01:18:35.417498 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.417380 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b2d2b0-69a2-4159-870b-86a62d8d045a" containerName="authorino" Jun 10 01:18:35.421851 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.421833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.425362 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.425342 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-82p82\"" Jun 10 01:18:35.425495 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.425369 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 01:18:35.425495 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.425346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 01:18:35.429995 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.429971 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-665586dff6-b2g9r"] Jun 10 01:18:35.540704 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.540661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76f1be85-cb49-43ed-91bc-7d9bb225b47e-webhook-cert\") pod \"maas-controller-665586dff6-b2g9r\" (UID: \"76f1be85-cb49-43ed-91bc-7d9bb225b47e\") " pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.540918 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.540720 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psfvf\" (UniqueName: \"kubernetes.io/projected/76f1be85-cb49-43ed-91bc-7d9bb225b47e-kube-api-access-psfvf\") pod \"maas-controller-665586dff6-b2g9r\" (UID: \"76f1be85-cb49-43ed-91bc-7d9bb225b47e\") " pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.642089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.642013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76f1be85-cb49-43ed-91bc-7d9bb225b47e-webhook-cert\") pod \"maas-controller-665586dff6-b2g9r\" (UID: \"76f1be85-cb49-43ed-91bc-7d9bb225b47e\") " pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.642089 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.642062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psfvf\" (UniqueName: \"kubernetes.io/projected/76f1be85-cb49-43ed-91bc-7d9bb225b47e-kube-api-access-psfvf\") pod \"maas-controller-665586dff6-b2g9r\" (UID: \"76f1be85-cb49-43ed-91bc-7d9bb225b47e\") " pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.644685 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.644652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76f1be85-cb49-43ed-91bc-7d9bb225b47e-webhook-cert\") pod \"maas-controller-665586dff6-b2g9r\" (UID: \"76f1be85-cb49-43ed-91bc-7d9bb225b47e\") " pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.651002 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.650971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psfvf\" (UniqueName: \"kubernetes.io/projected/76f1be85-cb49-43ed-91bc-7d9bb225b47e-kube-api-access-psfvf\") pod \"maas-controller-665586dff6-b2g9r\" (UID: \"76f1be85-cb49-43ed-91bc-7d9bb225b47e\") " pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.733515 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.733477 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:35.874330 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:18:35.874285 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f1be85_cb49_43ed_91bc_7d9bb225b47e.slice/crio-bddb45e5a4d3da4221aa3fc681c74a18fea6f82f89912c9ddb02e3ad3976cbea WatchSource:0}: Error finding container bddb45e5a4d3da4221aa3fc681c74a18fea6f82f89912c9ddb02e3ad3976cbea: Status 404 returned error can't find the container with id bddb45e5a4d3da4221aa3fc681c74a18fea6f82f89912c9ddb02e3ad3976cbea Jun 10 01:18:35.878098 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.878072 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6599dfcc-952a-48fe-9b8a-10d26d7865c7" path="/var/lib/kubelet/pods/6599dfcc-952a-48fe-9b8a-10d26d7865c7/volumes" Jun 10 01:18:35.878349 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:35.878334 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-665586dff6-b2g9r"] Jun 10 01:18:36.658012 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:36.657960 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-665586dff6-b2g9r" event={"ID":"76f1be85-cb49-43ed-91bc-7d9bb225b47e","Type":"ContainerStarted","Data":"b250e75982a4750a1248de5dc70a945e1742e189fe17248503395d3b11158c0e"} Jun 10 01:18:36.658453 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:36.658024 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-665586dff6-b2g9r" event={"ID":"76f1be85-cb49-43ed-91bc-7d9bb225b47e","Type":"ContainerStarted","Data":"bddb45e5a4d3da4221aa3fc681c74a18fea6f82f89912c9ddb02e3ad3976cbea"} Jun 10 01:18:36.658453 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:36.658061 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:18:36.673964 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:36.673901 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-665586dff6-b2g9r" podStartSLOduration=1.107874658 podStartE2EDuration="1.67385826s" totalImagesPullingTime="565.983602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:18:36.673812004 +0000 UTC m=+1057.251163151" watchObservedRunningTime="2026-06-10 01:18:36.67385826 +0000 UTC m=+1057.251209386" Jun 10 01:18:47.670299 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:18:47.670265 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-665586dff6-b2g9r" Jun 10 01:19:15.136188 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:19:15.136149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:15.237845 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:19:15.237805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:23.626111 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:19:23.626068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:29.579718 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:19:29.579671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:29.654948 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:19:29.654861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:56.561157 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:19:56.561119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:01.755777 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:01.755735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:01.854425 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:01.854387 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:25.738266 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:25.738174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:31.334973 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:31.334936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:31.393576 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:31.393530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:31.462594 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:31.462549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:31.562482 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:31.562445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:31.690830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:31.690720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:31.790612 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:31.790562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:48.274638 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:48.274579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:48.386375 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:48.386342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:48.491638 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:48.491597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:54.225594 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:54.225551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:54.325627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:54.325591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:20:59.914480 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:59.914444 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:20:59.918434 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:20:59.918408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:21:02.385633 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:02.385595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:02.440045 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:02.440006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:02.527202 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:02.527153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:02.627675 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:02.627625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:08.040506 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:08.040471 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:08.090619 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:08.090576 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:19.118626 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:19.118559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:19.222273 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:19.222239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:19.327371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:19.327338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:24.870544 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:24.870513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:24.919825 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:24.919790 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:43.295675 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:43.295615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:43.393925 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:43.393835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:43.496407 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:43.496368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:46.761766 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:46.761724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:49.145146 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:49.145115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:49.253354 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:49.253318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:49.351223 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:49.351180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:49.460993 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:49.460957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:55.075092 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:55.075060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:21:55.174936 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:21:55.174897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:25:39.497786 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:25:39.497739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:25:40.674366 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:25:40.674321 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:25:59.946194 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:25:59.946158 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:25:59.950482 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:25:59.950454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:30:59.980558 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:30:59.980529 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:30:59.985131 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:30:59.985106 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:32:24.176528 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:32:24.176431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:33:01.268606 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:33:01.268569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:33:01.319519 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:33:01.319485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:34:05.147377 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:05.147341 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f79987bd-wwtw6_1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b/authorino/0.log" Jun 10 01:34:07.311206 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:07.311155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:34:09.612578 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:09.612547 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6c9bfb4667-4c2t9_ce1277a3-2c9c-4d88-b68d-06318ed6064c/nginx/0.log" Jun 10 01:34:10.142135 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:10.142092 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cc657986f-cstcq_4d074eb3-4dda-4b95-9939-c92a6398ed59/maas-api/0.log" Jun 10 01:34:10.476225 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:10.476186 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-665586dff6-b2g9r_76f1be85-cb49-43ed-91bc-7d9bb225b47e/manager/0.log" Jun 10 01:34:10.825869 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:10.825791 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-g26z4_c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5/copy-manifests/0.log" Jun 10 01:34:10.832626 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:10.832605 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-g26z4_c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5/manager/0.log" Jun 10 01:34:12.399261 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:12.399233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f79987bd-wwtw6_1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b/authorino/0.log" Jun 10 01:34:12.641657 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:12.641626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qlmvr_a8acbcc7-ea2c-4874-a537-bd75b8c74c86/manager/0.log" Jun 10 01:34:13.221735 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:13.221704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-45xbl_6de4b75c-175b-4a0d-a6ff-c6e1047ce377/manager/0.log" Jun 10 01:34:13.790767 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:13.790735 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74976d49cb-27tct_8ee4d27c-4046-4a15-a4b0-1ccd398702ee/kube-auth-proxy/0.log" Jun 10 01:34:14.134226 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:14.134150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-bmzqq_869d2f33-cd96-4b28-a123-0b44b99bceb3/payload-pre-processing/0.log" Jun 10 01:34:14.246783 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:14.246754 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcpk8_714651f8-ef82-47a4-977b-cc5cab632cd4/payload-processing/0.log" Jun 10 01:34:14.352531 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:14.352498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-674d5448f-c27fw_25baebd5-131e-4414-902f-1582b10ca57f/router/0.log" Jun 10 01:34:14.797787 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:14.797755 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-rlpdc_7ef139ce-be06-47c3-a543-c8a992b3541d/storage-initializer/0.log" Jun 10 01:34:14.804590 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:14.804570 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-rlpdc_7ef139ce-be06-47c3-a543-c8a992b3541d/main/0.log" Jun 10 01:34:15.148065 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:15.147966 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-kkp47_1ce770b5-8806-4598-8e5e-41e79d3064bf/storage-initializer/0.log" Jun 10 01:34:15.155918 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:15.155890 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-kkp47_1ce770b5-8806-4598-8e5e-41e79d3064bf/main/0.log" Jun 10 01:34:19.029830 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:19.029798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:34:19.125857 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:19.125823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" limit=1024 Jun 10 01:34:22.163496 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:22.163463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wmvph_f390e74c-c25d-48c3-b820-f78faabb0f11/global-pull-secret-syncer/0.log" Jun 10 01:34:22.208593 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:22.208556 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kfsws_8cf2845f-69bb-4f26-ae3b-fd6d3d743825/konnectivity-agent/0.log" Jun 10 01:34:22.292420 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:22.292390 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-207.ec2.internal_3c0d397031f09076e54ac96b039a5d49/haproxy/0.log" Jun 10 01:34:27.435519 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:27.435426 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f79987bd-wwtw6_1d18560a-e5f9-4ae4-ac17-ac53f63f2e4b/authorino/0.log" Jun 10 01:34:27.486779 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:27.486747 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qlmvr_a8acbcc7-ea2c-4874-a537-bd75b8c74c86/manager/0.log" Jun 10 01:34:27.661270 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:27.661226 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-45xbl_6de4b75c-175b-4a0d-a6ff-c6e1047ce377/manager/0.log" Jun 10 01:34:29.520654 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.520626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-smddc_f748de4b-16f7-4253-9d1a-010c3341ad3d/cluster-monitoring-operator/0.log" Jun 10 01:34:29.553049 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.553024 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sj9w5_6645236f-5b1e-4b72-94ec-a60fa26d7002/kube-state-metrics/0.log" Jun 10 01:34:29.571437 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.571409 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sj9w5_6645236f-5b1e-4b72-94ec-a60fa26d7002/kube-rbac-proxy-main/0.log" Jun 10 01:34:29.599484 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.599458 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sj9w5_6645236f-5b1e-4b72-94ec-a60fa26d7002/kube-rbac-proxy-self/0.log" Jun 10 01:34:29.760626 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.760545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-km98j_e0ba70ae-0548-4863-bdb6-e94715a3c57d/node-exporter/0.log" Jun 10 01:34:29.783571 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.783546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-km98j_e0ba70ae-0548-4863-bdb6-e94715a3c57d/kube-rbac-proxy/0.log" Jun 10 01:34:29.810299 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:29.810273 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-km98j_e0ba70ae-0548-4863-bdb6-e94715a3c57d/init-textfile/0.log" Jun 10 01:34:30.047832 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.047763 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/prometheus/0.log" Jun 10 01:34:30.067809 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.067781 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/config-reloader/0.log" Jun 10 01:34:30.088573 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.088549 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/thanos-sidecar/0.log" Jun 10 01:34:30.111477 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.111451 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/kube-rbac-proxy-web/0.log" Jun 10 01:34:30.136333 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.136309 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/kube-rbac-proxy/0.log" Jun 10 01:34:30.157440 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.157381 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/kube-rbac-proxy-thanos/0.log" Jun 10 01:34:30.182735 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.182693 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dea3c0a6-7e89-4f7f-b225-7fb353cef0a4/init-config-reloader/0.log" Jun 10 01:34:30.215999 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.215966 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-qkrbg_a035ed0f-ed46-4578-a73c-405a2072144e/prometheus-operator/0.log" Jun 10 01:34:30.234971 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.234940 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-qkrbg_a035ed0f-ed46-4578-a73c-405a2072144e/kube-rbac-proxy/0.log" Jun 10 01:34:30.393921 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.393870 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/thanos-query/0.log" Jun 10 01:34:30.415717 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.415679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy-web/0.log" Jun 10 01:34:30.436388 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.436363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy/0.log" Jun 10 01:34:30.456465 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.456440 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/prom-label-proxy/0.log" Jun 10 01:34:30.479394 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.479361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy-rules/0.log" Jun 10 01:34:30.500775 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:30.500743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747cfdd66f-wldkz_760ff3d5-e577-43be-98de-0090c3da7ccd/kube-rbac-proxy-metrics/0.log" Jun 10 01:34:31.949244 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:31.949214 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-cwtdn_e3430e8f-1d03-4c64-a3db-5ec21899c9d2/networking-console-plugin/0.log" Jun 10 01:34:32.563450 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:32.563419 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/1.log" Jun 10 01:34:32.568114 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:32.568091 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-vj4pt_369c289b-16d2-4be8-8cc8-0f80271e4e38/console-operator/2.log" Jun 10 01:34:33.924599 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.924563 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5"] Jun 10 01:34:33.928331 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.928310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:33.930896 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.930852 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwhkl\"/\"kube-root-ca.crt\"" Jun 10 01:34:33.931009 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.930978 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwhkl\"/\"openshift-service-ca.crt\"" Jun 10 01:34:33.931095 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.931074 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qwhkl\"/\"default-dockercfg-jkj8p\"" Jun 10 01:34:33.937647 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.937622 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5"] Jun 10 01:34:33.958164 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.958130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt46l\" (UniqueName: \"kubernetes.io/projected/bc996728-123e-49c9-b4cf-bcf4715052ea-kube-api-access-tt46l\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:33.958164 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.958162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-proc\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:33.958351 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.958188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-podres\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:33.958351 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.958258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-sys\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:33.958425 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:33.958345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-lib-modules\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059134 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt46l\" (UniqueName: \"kubernetes.io/projected/bc996728-123e-49c9-b4cf-bcf4715052ea-kube-api-access-tt46l\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059134 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-proc\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-podres\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059176 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-sys\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059238 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-proc\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-lib-modules\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-podres\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059318 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-lib-modules\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.059386 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.059328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc996728-123e-49c9-b4cf-bcf4715052ea-sys\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.066739 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.066711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt46l\" (UniqueName: \"kubernetes.io/projected/bc996728-123e-49c9-b4cf-bcf4715052ea-kube-api-access-tt46l\") pod \"perf-node-gather-daemonset-fhcr5\" (UID: \"bc996728-123e-49c9-b4cf-bcf4715052ea\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.239034 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.239007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:34.378260 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:34.378231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5"] Jun 10 01:34:34.380890 ip-10-0-131-207 kubenswrapper[2565]: W0610 01:34:34.380838 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc996728_123e_49c9_b4cf_bcf4715052ea.slice/crio-bd8cbe964d7d556a9a0937aaddf6cba1042849d5ebfc3ef4ab65cc4a78dd4376 WatchSource:0}: Error finding container bd8cbe964d7d556a9a0937aaddf6cba1042849d5ebfc3ef4ab65cc4a78dd4376: Status 404 returned error can't find the container with id bd8cbe964d7d556a9a0937aaddf6cba1042849d5ebfc3ef4ab65cc4a78dd4376 Jun 10 01:34:35.137304 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.137274 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfddt_2caca382-1d26-40ad-91ec-515564f2319c/dns/0.log" Jun 10 01:34:35.158748 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.158717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfddt_2caca382-1d26-40ad-91ec-515564f2319c/kube-rbac-proxy/0.log" Jun 10 01:34:35.355373 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.355330 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" event={"ID":"bc996728-123e-49c9-b4cf-bcf4715052ea","Type":"ContainerStarted","Data":"773558ac79632db0cc00b43949a0ec895be97255b0fc59f91b0e938130ba2595"} Jun 10 01:34:35.355571 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.355385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" event={"ID":"bc996728-123e-49c9-b4cf-bcf4715052ea","Type":"ContainerStarted","Data":"bd8cbe964d7d556a9a0937aaddf6cba1042849d5ebfc3ef4ab65cc4a78dd4376"} Jun 10 01:34:35.355571 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.355412 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:35.360722 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.360702 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54cm8_2d1e069d-e288-4697-8f70-6213cef84bf5/dns-node-resolver/0.log" Jun 10 01:34:35.369722 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:35.369676 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" podStartSLOduration=2.3696608550000002 podStartE2EDuration="2.369660855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:34:35.369120651 +0000 UTC m=+2015.946471778" watchObservedRunningTime="2026-06-10 01:34:35.369660855 +0000 UTC m=+2015.947011984" Jun 10 01:34:36.037783 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:36.037753 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ljgg_b34d5e2e-4115-4802-8f98-8914e2b01e12/node-ca/0.log" Jun 10 01:34:37.068119 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:37.068088 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74976d49cb-27tct_8ee4d27c-4046-4a15-a4b0-1ccd398702ee/kube-auth-proxy/0.log" Jun 10 01:34:37.206526 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:37.206495 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-bmzqq_869d2f33-cd96-4b28-a123-0b44b99bceb3/payload-pre-processing/0.log" Jun 10 01:34:37.254528 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:37.254494 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcpk8_714651f8-ef82-47a4-977b-cc5cab632cd4/payload-processing/0.log" Jun 10 01:34:37.276462 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:37.276433 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-674d5448f-c27fw_25baebd5-131e-4414-902f-1582b10ca57f/router/0.log" Jun 10 01:34:37.882448 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:37.882412 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hh2q_7f152419-a11c-4256-9ecc-778174e1b31c/serve-healthcheck-canary/0.log" Jun 10 01:34:38.613209 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:38.613176 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwkd2_1eca53e5-fb44-4e3f-9753-022386591761/kube-rbac-proxy/0.log" Jun 10 01:34:38.632808 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:38.632782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwkd2_1eca53e5-fb44-4e3f-9753-022386591761/exporter/0.log" Jun 10 01:34:38.654054 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:38.654022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwkd2_1eca53e5-fb44-4e3f-9753-022386591761/extractor/0.log" Jun 10 01:34:40.777944 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:40.777897 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6c9bfb4667-4c2t9_ce1277a3-2c9c-4d88-b68d-06318ed6064c/nginx/0.log" Jun 10 01:34:40.914771 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:40.914724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cc657986f-cstcq_4d074eb3-4dda-4b95-9939-c92a6398ed59/maas-api/0.log" Jun 10 01:34:41.008571 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:41.008518 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-665586dff6-b2g9r_76f1be85-cb49-43ed-91bc-7d9bb225b47e/manager/0.log" Jun 10 01:34:41.097703 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:41.097609 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-g26z4_c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5/manager/0.log" Jun 10 01:34:41.116810 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:41.116781 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-g26z4_c7ac6ef1-b799-4a69-ac0a-2d39c2209eb5/copy-manifests/0.log" Jun 10 01:34:41.371337 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:41.371264 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-fhcr5" Jun 10 01:34:42.992627 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:42.992601 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dcf7bd6dd-qwdjd_23c09c4a-daad-45b0-9ab9-d0f8dedfab0d/manager/0.log" Jun 10 01:34:47.774582 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:47.774526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74976d49cb-27tct_8ee4d27c-4046-4a15-a4b0-1ccd398702ee/kube-auth-proxy/0.log" Jun 10 01:34:47.872349 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:47.872293 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-bmzqq_869d2f33-cd96-4b28-a123-0b44b99bceb3/payload-pre-processing/0.log" Jun 10 01:34:47.910269 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:47.910233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcpk8_714651f8-ef82-47a4-977b-cc5cab632cd4/payload-processing/0.log" Jun 10 01:34:47.925147 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:47.925121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-674d5448f-c27fw_25baebd5-131e-4414-902f-1582b10ca57f/router/0.log" Jun 10 01:34:48.398371 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:48.398342 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-p9xjn_a5b12865-87b9-4188-bc0d-e0022108ba5e/migrator/0.log" Jun 10 01:34:48.417236 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:48.417210 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-p9xjn_a5b12865-87b9-4188-bc0d-e0022108ba5e/graceful-termination/0.log" Jun 10 01:34:49.140922 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:49.140896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74976d49cb-27tct_8ee4d27c-4046-4a15-a4b0-1ccd398702ee/kube-auth-proxy/0.log" Jun 10 01:34:49.251034 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:49.251007 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-bmzqq_869d2f33-cd96-4b28-a123-0b44b99bceb3/payload-pre-processing/0.log" Jun 10 01:34:49.294939 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:49.294903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcpk8_714651f8-ef82-47a4-977b-cc5cab632cd4/payload-processing/0.log" Jun 10 01:34:49.314476 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:49.314443 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-674d5448f-c27fw_25baebd5-131e-4414-902f-1582b10ca57f/router/0.log" Jun 10 01:34:50.051102 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.051080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/kube-multus-additional-cni-plugins/0.log" Jun 10 01:34:50.073537 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.073511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/egress-router-binary-copy/0.log" Jun 10 01:34:50.093570 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.093543 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/cni-plugins/0.log" Jun 10 01:34:50.112782 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.112753 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/bond-cni-plugin/0.log" Jun 10 01:34:50.131724 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.131696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/routeoverride-cni/0.log" Jun 10 01:34:50.150677 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.150649 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/whereabouts-cni-bincopy/0.log" Jun 10 01:34:50.172083 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.172050 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9t7lv_471da43b-a7c9-44db-8932-8dede3223082/whereabouts-cni/0.log" Jun 10 01:34:50.560301 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.560268 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xp4xj_b146bf69-8c8d-43b0-b2d5-cd0d73b78b6c/kube-multus/0.log" Jun 10 01:34:50.668241 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.668209 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t9m95_5b69a9f4-8620-4a7c-adaa-4a20f0e6c675/network-metrics-daemon/0.log" Jun 10 01:34:50.686785 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.686759 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t9m95_5b69a9f4-8620-4a7c-adaa-4a20f0e6c675/kube-rbac-proxy/0.log" Jun 10 01:34:50.920541 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:50.920455 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74976d49cb-27tct_8ee4d27c-4046-4a15-a4b0-1ccd398702ee/kube-auth-proxy/0.log" Jun 10 01:34:51.015242 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:51.015212 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-bmzqq_869d2f33-cd96-4b28-a123-0b44b99bceb3/payload-pre-processing/0.log" Jun 10 01:34:51.054866 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:51.054822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcpk8_714651f8-ef82-47a4-977b-cc5cab632cd4/payload-processing/0.log" Jun 10 01:34:51.068266 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:51.068233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-674d5448f-c27fw_25baebd5-131e-4414-902f-1582b10ca57f/router/0.log" Jun 10 01:34:52.108037 ip-10-0-131-207 kubenswrapper[2565]: I0610 01:34:52.108003 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c42rl_0175d55c-412a-4863-a379-61be7e4a967c/ovn-controller/0.log"