Jun 15 03:18:00.429378 ip-10-0-134-131 systemd[1]: Starting Kubernetes Kubelet... Jun 15 03:18:00.878560 ip-10-0-134-131 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 03:18:00.878560 ip-10-0-134-131 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 03:18:00.878560 ip-10-0-134-131 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 03:18:00.878560 ip-10-0-134-131 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 03:18:00.878560 ip-10-0-134-131 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 03:18:00.881572 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.881499 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 03:18:00.886457 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886443 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:18:00.886457 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886457 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886463 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886468 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886472 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886476 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886479 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886482 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886486 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886488 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886491 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886494 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886496 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886499 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886511 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886514 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886516 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886520 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886524 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886527 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:18:00.886522 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886530 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886533 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886535 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886538 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886541 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886543 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886546 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886548 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886551 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886553 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886556 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886559 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886561 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886564 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886566 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886569 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886571 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886574 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886576 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886579 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:18:00.887046 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886581 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886584 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886586 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886589 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886591 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886595 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886597 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886600 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886603 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886605 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886608 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886611 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886614 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886616 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886619 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886622 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886625 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886627 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886629 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886632 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:18:00.887822 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886634 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886637 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886640 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886642 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886645 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886647 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886650 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886652 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886655 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886658 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886660 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886671 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886675 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886677 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886680 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886682 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886686 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886689 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886691 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886694 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:18:00.889137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886697 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886699 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886702 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886705 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886708 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886711 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886714 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886717 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886719 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886723 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886726 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886729 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886732 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886735 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886737 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886740 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886742 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886745 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.886748 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:18:00.889640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888939 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888949 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888953 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888956 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888959 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888962 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888965 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888968 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888971 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888974 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888976 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888980 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888984 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888987 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888990 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.888997 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889000 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889002 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889005 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:18:00.890110 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889007 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889010 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889013 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889016 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889018 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889021 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889023 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889026 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889028 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889031 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889034 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889037 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889041 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889044 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889047 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889050 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889052 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889055 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889058 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889060 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:18:00.890626 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889063 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889065 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889068 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889070 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889074 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889078 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889081 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889084 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889087 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889089 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889092 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889095 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889097 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889100 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889102 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889105 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889108 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889111 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889113 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:18:00.891182 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889116 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889118 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889121 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889123 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889126 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889130 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889133 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889136 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889139 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889142 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889163 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889166 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889171 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889175 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889178 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889180 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889183 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889185 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889188 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889190 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:18:00.891647 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889193 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889195 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889198 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889200 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889204 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889206 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889209 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889211 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889214 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889217 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889220 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889222 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889225 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889227 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889229 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889232 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889234 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889237 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889240 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:18:00.892132 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889243 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889608 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889612 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889615 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889618 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889621 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889624 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889627 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889630 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889632 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889635 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889638 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889640 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889643 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889646 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889649 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889652 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889661 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889664 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889667 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:18:00.892747 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889669 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889672 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889675 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889678 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889680 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889683 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889686 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889689 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889691 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889694 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889696 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889699 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889702 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889705 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889707 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889710 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889713 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889715 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889718 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:18:00.893261 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889721 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889724 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889728 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889732 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889735 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889738 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889741 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889744 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889747 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889749 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889752 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889755 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889758 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889761 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889763 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889766 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889769 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889771 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889774 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:18:00.893723 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889776 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889779 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889781 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889784 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889787 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889790 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889793 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889795 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889798 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889801 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889804 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889806 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889809 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889811 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889814 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889817 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889819 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889822 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889824 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889826 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:18:00.894205 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889829 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889832 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889835 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889838 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889841 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889844 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889846 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889849 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889852 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889854 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889857 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889859 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889863 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889866 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889869 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889872 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889880 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889884 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889886 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:18:00.894707 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889889 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889892 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.889895 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889963 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889970 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889976 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889980 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889984 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889987 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889991 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889995 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.889998 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890001 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890007 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890010 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890013 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890016 2559 flags.go:64] FLAG: --cgroup-root="" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890019 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890022 2559 flags.go:64] FLAG: --client-ca-file="" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890026 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890029 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890034 2559 flags.go:64] FLAG: --cluster-domain="" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890036 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890039 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 03:18:00.895179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890043 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890046 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890050 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890053 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890056 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890061 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890064 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890067 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890070 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890073 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890076 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890080 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890083 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890086 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890089 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890092 2559 flags.go:64] FLAG: --enable-server="true" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890095 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890099 2559 flags.go:64] FLAG: --event-burst="100" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890102 2559 flags.go:64] FLAG: --event-qps="50" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890105 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890108 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890112 2559 flags.go:64] FLAG: --eviction-hard="" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890116 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890120 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890122 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 03:18:00.895755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890126 2559 flags.go:64] FLAG: --eviction-soft="" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890129 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890132 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890135 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890138 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890141 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890159 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890165 2559 flags.go:64] FLAG: --feature-gates="" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890169 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890172 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890175 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890178 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890182 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890185 2559 flags.go:64] FLAG: --help="false" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890188 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-134-131.ec2.internal" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890191 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890194 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890197 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890200 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890204 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890206 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890209 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890212 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 03:18:00.896413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890215 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890218 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890221 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890223 2559 flags.go:64] FLAG: --kube-reserved="" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890226 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890230 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890233 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890236 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890239 2559 flags.go:64] FLAG: --lock-file="" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890242 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890244 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890247 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890252 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890256 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890259 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890261 2559 flags.go:64] FLAG: --logging-format="text" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890264 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890267 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890270 2559 flags.go:64] FLAG: --manifest-url="" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890273 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890276 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890281 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890284 2559 flags.go:64] FLAG: --max-pods="110" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890287 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890290 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 03:18:00.897014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890293 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890296 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890299 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890302 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890305 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890311 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890314 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890317 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890320 2559 flags.go:64] FLAG: --pod-cidr="" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890323 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890329 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890332 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890336 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890339 2559 flags.go:64] FLAG: --port="10250" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890342 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890345 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c36e2c428a6c64e" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890348 2559 flags.go:64] FLAG: --qos-reserved="" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890351 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890354 2559 flags.go:64] FLAG: --register-node="true" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890357 2559 flags.go:64] FLAG: --register-with-taints="" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890360 2559 flags.go:64] FLAG: --registry-burst="10" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890364 2559 flags.go:64] FLAG: --registry-qps="5" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890366 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890369 2559 flags.go:64] FLAG: --reserved-memory="" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890373 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 03:18:00.897636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890376 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890379 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890381 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890384 2559 flags.go:64] FLAG: --runonce="false" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890388 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890391 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890394 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890397 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890400 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890403 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890406 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890409 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890412 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890415 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890417 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890420 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890423 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890426 2559 flags.go:64] FLAG: --system-cgroups="" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890429 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890436 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890439 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890441 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890445 2559 flags.go:64] FLAG: --tls-min-version="" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890448 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890451 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 03:18:00.898267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890454 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890457 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890460 2559 flags.go:64] FLAG: --v="2" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890464 2559 flags.go:64] FLAG: --version="false" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890471 2559 flags.go:64] FLAG: --vmodule="" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890474 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890478 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890588 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890591 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890594 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890597 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890601 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890604 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890607 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890610 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890612 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890615 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890618 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890620 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890623 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890625 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:18:00.898887 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890628 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890631 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890635 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890637 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890640 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890644 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890647 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890649 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890652 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890654 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890657 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890660 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890673 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890677 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890680 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890683 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890686 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890688 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890691 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890693 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:18:00.899396 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890697 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890699 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890702 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890705 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890707 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890710 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890716 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890719 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890721 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890724 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890726 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890728 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890731 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890733 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890737 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890741 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890745 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890748 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890751 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:18:00.899888 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890754 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890756 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890759 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890761 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890764 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890766 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890769 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890772 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890774 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890776 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890780 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890783 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890786 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890788 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890791 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890794 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890797 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890800 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890802 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890805 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:18:00.900382 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890807 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890810 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890812 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890815 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890818 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890820 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890823 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890826 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890828 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890831 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890833 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890836 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890840 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890843 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890847 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890849 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890852 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890855 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890857 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:18:00.900860 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890860 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890862 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890864 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890867 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890870 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890873 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.890875 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.890880 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.897633 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.897646 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.898549 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.898556 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898608 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898615 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898619 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:18:00.901375 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898622 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898625 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898628 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898630 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898633 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898636 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898638 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898641 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898643 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898646 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898648 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898651 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898653 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898656 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898658 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898661 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898673 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898677 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898679 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:18:00.901772 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898682 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898684 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898687 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898689 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898692 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898694 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898697 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898701 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898704 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898707 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898709 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898712 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898715 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898718 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898720 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898723 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898725 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898728 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898731 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898733 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:18:00.902241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898736 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898738 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898741 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898743 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898746 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898749 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898751 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898754 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898756 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898758 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898761 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898763 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898766 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898768 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898771 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898773 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898775 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898778 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898781 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898784 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:18:00.902768 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898787 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898790 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898792 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898796 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898800 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898803 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898806 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898809 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898811 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898814 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898817 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898820 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898822 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898825 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898829 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898832 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898835 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898837 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898840 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:18:00.903271 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898843 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898845 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898848 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898850 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898853 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898856 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898859 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898861 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898864 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898867 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898869 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898872 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898874 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898877 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898880 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898882 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898885 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:18:00.903757 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.898888 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.898893 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899012 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899017 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899020 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899023 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899026 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899028 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899031 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899034 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899036 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899039 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899043 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899046 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899049 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:18:00.904203 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899052 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899054 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899057 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899060 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899062 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899065 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899067 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899070 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899072 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899075 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899078 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899080 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899083 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899085 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899088 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899091 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899094 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899096 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899099 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899102 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:18:00.904565 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899104 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899107 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899110 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899112 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899115 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899117 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899120 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899123 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899125 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899128 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899130 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899133 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899135 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899138 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899142 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899160 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899164 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899167 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899170 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899173 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:18:00.905041 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899175 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899178 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899181 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899183 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899186 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899189 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899191 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899193 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899197 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899199 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899202 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899204 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899207 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899209 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899211 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899214 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899217 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899219 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899222 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899224 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:18:00.905654 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899226 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899229 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899231 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899234 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899236 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899238 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899241 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899244 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899246 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899249 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899251 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899253 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899256 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899260 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899263 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899266 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899269 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899272 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899275 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:18:00.906123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899277 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899280 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899283 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899286 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899288 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899291 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:00.899293 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.899298 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.899387 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.902570 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.904184 2559 server.go:1019] "Starting client certificate rotation" Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.904278 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 03:18:00.906585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.904315 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 03:18:00.906979 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.906967 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 03:18:00.907990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.907971 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 03:18:00.919481 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.919460 2559 log.go:25] "Validated CRI v1 runtime API" Jun 15 03:18:00.923188 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.923174 2559 log.go:25] "Validated CRI v1 image API" Jun 15 03:18:00.925605 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.925586 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 03:18:00.930310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.930294 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 03:18:00.930674 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.930652 2559 fs.go:135] Filesystem UUIDs: map[3ceb2a44-f6f6-4a22-ab6d-040dfedd336e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f337aaf8-79fd-4d2f-bb5e-f867a89426e4:/dev/nvme0n1p4] Jun 15 03:18:00.930717 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.930677 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 03:18:00.935206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.935096 2559 manager.go:216] Machine: {Timestamp:2026-06-15 03:18:00.934628389 +0000 UTC m=+0.378823088 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105751 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb29713090ae77ecb88812deecb2a SystemUUID:ec2fb297-1309-0ae7-7ecb-88812deecb2a BootID:7a8ff11d-44c2-42ce-ba0c-6dbaa2988041 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:a4:3d:a6:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:a4:3d:a6:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:de:0d:10:60:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 03:18:00.935206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.935205 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 03:18:00.935313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.935294 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 03:18:00.938869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.938846 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 03:18:00.938990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.938872 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-131.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 03:18:00.939695 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.939685 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 03:18:00.939728 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.939698 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 03:18:00.939728 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.939705 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 03:18:00.940722 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.940712 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 03:18:00.942604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.942594 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 03:18:00.948019 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948007 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 15 03:18:00.948158 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948138 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 03:18:00.948195 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948178 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 15 03:18:00.948195 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948187 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 03:18:00.948252 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948200 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 03:18:00.948252 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948209 2559 kubelet.go:398] "Adding apiserver pod source" Jun 15 03:18:00.948252 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948217 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 03:18:00.948550 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948538 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 03:18:00.948581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.948563 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 03:18:00.951691 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.951674 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 03:18:00.953477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953461 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 03:18:00.953556 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953499 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 03:18:00.953682 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953670 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 03:18:00.953750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953689 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 03:18:00.953750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953698 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 03:18:00.953750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953707 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 03:18:00.953750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953719 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 03:18:00.953750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.953728 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 03:18:00.954306 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.954288 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 03:18:00.954306 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.954311 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 03:18:00.954416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.954322 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 03:18:00.954416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.954331 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 03:18:00.954416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.954354 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 03:18:00.954416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.954367 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 03:18:00.955301 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.955281 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 03:18:00.955301 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.955298 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 03:18:00.957687 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:00.957657 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 03:18:00.957900 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.957885 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-131.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 03:18:00.958065 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:00.958037 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 03:18:00.958304 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.958292 2559 server.go:1268] "Started kubelet" Jun 15 03:18:00.958393 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.958365 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 03:18:00.961334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.958463 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 03:18:00.961546 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.961519 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 03:18:00.961887 ip-10-0-134-131 systemd[1]: Started Kubernetes Kubelet. Jun 15 03:18:00.963241 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.963221 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 15 03:18:00.964868 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.964848 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vl5q9" Jun 15 03:18:00.966574 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.966557 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 03:18:00.967014 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:00.965928 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-131.ec2.internal.18b922e1d6310e96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-131.ec2.internal,UID:ip-10-0-134-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-131.ec2.internal,},FirstTimestamp:2026-06-15 03:18:00.95826703 +0000 UTC m=+0.402461727,LastTimestamp:2026-06-15 03:18:00.95826703 +0000 UTC m=+0.402461727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-131.ec2.internal,}" Jun 15 03:18:00.968090 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:00.968070 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 03:18:00.970730 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.970716 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vl5q9" Jun 15 03:18:00.972638 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.972624 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 03:18:00.972693 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.972637 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 03:18:00.972829 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:00.972810 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:00.973358 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973341 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 03:18:00.973455 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973352 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 03:18:00.973455 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973414 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 03:18:00.973552 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973488 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 03:18:00.973552 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973503 2559 factory.go:55] Registering systemd factory Jun 15 03:18:00.973552 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973512 2559 factory.go:223] Registration of the systemd container factory successfully Jun 15 03:18:00.973552 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973522 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 15 03:18:00.973552 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973534 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 15 03:18:00.973779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973703 2559 factory.go:153] Registering CRI-O factory Jun 15 03:18:00.973779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973715 2559 factory.go:223] Registration of the crio container factory successfully Jun 15 03:18:00.973779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973732 2559 factory.go:103] Registering Raw factory Jun 15 03:18:00.973779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.973742 2559 manager.go:1196] Started watching for new ooms in manager Jun 15 03:18:00.974088 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.974077 2559 manager.go:349] Starting recovery of all containers Jun 15 03:18:00.982919 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.982903 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:18:00.983000 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.982920 2559 manager.go:354] Recovery completed Jun 15 03:18:00.985800 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:00.985781 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-131.ec2.internal\" not found" node="ip-10-0-134-131.ec2.internal" Jun 15 03:18:00.987171 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.987132 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:00.989123 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989107 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:00.989202 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989134 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:00.989202 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989157 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:00.989689 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989675 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 03:18:00.989689 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989686 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 03:18:00.989689 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989689 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:00.989835 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.989701 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 15 03:18:00.990416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.990401 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:00.990488 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.990437 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:00.990488 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.990452 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:00.991696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.991682 2559 policy_none.go:49] "None policy: Start" Jun 15 03:18:00.991741 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.991698 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 03:18:00.991741 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.991708 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 03:18:00.993701 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:00.993691 2559 policy_none.go:47] "Start" Jun 15 03:18:01.039604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.039580 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.040647 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.040672 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.040691 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.040748 2559 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.040807 2559 manager.go:337] "Starting Device Plugin manager" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.040863 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.040875 2559 server.go:87] "Starting device plugin registration server" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.041123 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.041136 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.041287 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.041355 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.041365 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.042482 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.042532 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.055163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.043469 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:18:01.141800 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.141723 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal"] Jun 15 03:18:01.141917 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.141811 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:01.141917 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.141731 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:01.142676 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.142653 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:01.142750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.142689 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:01.142750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.142702 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:01.142750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.142723 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.143403 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.143389 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:01.143457 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.143413 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:01.143457 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.143425 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:01.145589 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.145578 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:01.145718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.145701 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.145779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.145753 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:01.146288 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.146267 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:01.146366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.146302 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:01.146366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.146316 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:01.146366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.146320 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:01.146366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.146342 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:01.146366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.146354 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:01.148330 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.148317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.148379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.148341 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:18:01.148720 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.148706 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.148763 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.148730 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-131.ec2.internal\": node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.148977 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.148960 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:18:01.149021 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.148992 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:18:01.149021 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.149006 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:18:01.162115 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.162099 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.174883 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.174866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f9144b803da67fa3f191cfe3efc11199-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal\" (UID: \"f9144b803da67fa3f191cfe3efc11199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.174953 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.174891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9144b803da67fa3f191cfe3efc11199-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal\" (UID: \"f9144b803da67fa3f191cfe3efc11199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.174953 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.174907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbce36964cb706e702654efc4cca68d1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-131.ec2.internal\" (UID: \"bbce36964cb706e702654efc4cca68d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.178720 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.178696 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-131.ec2.internal\" not found" node="ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.181979 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.181964 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-131.ec2.internal\" not found" node="ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.262320 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.262297 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.275874 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.275853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f9144b803da67fa3f191cfe3efc11199-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal\" (UID: \"f9144b803da67fa3f191cfe3efc11199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.275948 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.275876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9144b803da67fa3f191cfe3efc11199-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal\" (UID: \"f9144b803da67fa3f191cfe3efc11199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.275948 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.275893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbce36964cb706e702654efc4cca68d1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-131.ec2.internal\" (UID: \"bbce36964cb706e702654efc4cca68d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.275948 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.275927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbce36964cb706e702654efc4cca68d1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-131.ec2.internal\" (UID: \"bbce36964cb706e702654efc4cca68d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.276044 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.275960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f9144b803da67fa3f191cfe3efc11199-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal\" (UID: \"f9144b803da67fa3f191cfe3efc11199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.276044 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.275960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9144b803da67fa3f191cfe3efc11199-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal\" (UID: \"f9144b803da67fa3f191cfe3efc11199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.362589 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.362566 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.463248 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.463190 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.481684 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.481660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.486613 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.486598 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" Jun 15 03:18:01.563433 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.563411 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.663880 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.663855 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.764419 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.764373 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.864891 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.864861 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.904344 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.904325 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 03:18:01.904905 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.904474 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 03:18:01.904905 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.904473 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 03:18:01.965665 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:01.965637 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:01.977103 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.977072 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 03:13:00 +0000 UTC" deadline="2028-01-11 00:56:46.720894274 +0000 UTC" Jun 15 03:18:01.977103 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:01.977100 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13797h38m44.743797214s" Jun 15 03:18:02.032469 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:02.032437 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbce36964cb706e702654efc4cca68d1.slice/crio-d1d198f2ce167c7cd1cd7f9070e5a481e9716226dcd1cf5b86cf48e24c4f1b05 WatchSource:0}: Error finding container d1d198f2ce167c7cd1cd7f9070e5a481e9716226dcd1cf5b86cf48e24c4f1b05: Status 404 returned error can't find the container with id d1d198f2ce167c7cd1cd7f9070e5a481e9716226dcd1cf5b86cf48e24c4f1b05 Jun 15 03:18:02.033610 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:02.033588 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9144b803da67fa3f191cfe3efc11199.slice/crio-f9813524215f31c36aa40d085768812aeae1a48f9fedd035449d62098c827c18 WatchSource:0}: Error finding container f9813524215f31c36aa40d085768812aeae1a48f9fedd035449d62098c827c18: Status 404 returned error can't find the container with id f9813524215f31c36aa40d085768812aeae1a48f9fedd035449d62098c827c18 Jun 15 03:18:02.037540 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.037524 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:18:02.045408 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.045342 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" event={"ID":"f9144b803da67fa3f191cfe3efc11199","Type":"ContainerStarted","Data":"f9813524215f31c36aa40d085768812aeae1a48f9fedd035449d62098c827c18"} Jun 15 03:18:02.046321 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.046299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" event={"ID":"bbce36964cb706e702654efc4cca68d1","Type":"ContainerStarted","Data":"d1d198f2ce167c7cd1cd7f9070e5a481e9716226dcd1cf5b86cf48e24c4f1b05"} Jun 15 03:18:02.065750 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.065722 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:02.166200 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.166178 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:02.176375 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.176358 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:18:02.266704 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.266684 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:02.367235 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.367170 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-131.ec2.internal\" not found" Jun 15 03:18:02.440501 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.440478 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:18:02.473511 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.473486 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" Jun 15 03:18:02.484141 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.484121 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 03:18:02.485331 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.485307 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" Jun 15 03:18:02.491277 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.491258 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 03:18:02.948859 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.948830 2559 apiserver.go:52] "Watching apiserver" Jun 15 03:18:02.957813 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.957782 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:18:02.958327 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.958307 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 03:18:02.958738 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.958710 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-jx2mb","openshift-multus/multus-sj4vt","kube-system/konnectivity-agent-75qhw","openshift-cluster-node-tuning-operator/tuned-4dwsr","openshift-multus/network-metrics-daemon-s79jd","openshift-network-diagnostics/network-check-target-v4hp7","openshift-network-operator/iptables-alerter-hfd4h","openshift-ovn-kubernetes/ovnkube-node-lnxn5","kube-system/global-pull-secret-syncer-xfmcz","kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2","openshift-dns/node-resolver-757bh","openshift-image-registry/node-ca-77tnc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal"] Jun 15 03:18:02.961178 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.961143 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:02.963244 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.963221 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:02.963782 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.963632 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:02.963782 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.963683 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 03:18:02.963782 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.963748 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.963985 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.963813 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bzfdt\"" Jun 15 03:18:02.965293 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.965277 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 03:18:02.965467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.965453 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:02.965668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.965647 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.965762 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.965753 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qv8zl\"" Jun 15 03:18:02.965854 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.965836 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 03:18:02.967563 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.967542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.967955 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.967936 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 03:18:02.968179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.968140 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wpjmw\"" Jun 15 03:18:02.968259 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.968213 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 03:18:02.970023 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.969804 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:02.970023 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.969868 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:02.970023 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.969904 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:02.970023 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.969908 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.970023 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.969935 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zfd7j\"" Jun 15 03:18:02.972000 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.971975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:02.972090 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.972039 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:02.973604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.973300 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 03:18:02.974410 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.974387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:02.974500 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:02.974460 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:02.976696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.976668 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:02.979290 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979020 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vpbk\"" Jun 15 03:18:02.979379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979307 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 03:18:02.979462 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979440 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sj4vt" Jun 15 03:18:02.979521 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979474 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.979656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979639 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 03:18:02.979722 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979674 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 03:18:02.979722 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.979688 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 03:18:02.981506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.981462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:02.981732 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.981621 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 03:18:02.981732 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.981639 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xwlfk\"" Jun 15 03:18:02.982847 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.982829 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 03:18:02.983885 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.983865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:02.984164 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984132 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tgc2v\"" Jun 15 03:18:02.984869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984432 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 03:18:02.984869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984490 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 03:18:02.984869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984580 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 03:18:02.984869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-host-slash\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:02.984869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-host\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985112 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:02.985112 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dbaa831-e640-4995-aa01-71d1286ee59f-host\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:02.985112 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-modprobe-d\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985112 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.984983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-systemd\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985306 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-tuned\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:02.985439 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp9jn\" (UniqueName: \"kubernetes.io/projected/6dbaa831-e640-4995-aa01-71d1286ee59f-kube-api-access-fp9jn\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:02.985439 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-run\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985522 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-sys\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985565 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-lib-modules\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985599 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-var-lib-kubelet\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12877bea-aec9-4962-b0ea-53657adcb9e1-kubelet-config\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:02.985635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f43cde1a-9c08-4a6a-9492-ecc277ec8612-konnectivity-ca\") pod \"konnectivity-agent-75qhw\" (UID: \"f43cde1a-9c08-4a6a-9492-ecc277ec8612\") " pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:02.985704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysconfig\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-tmp\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f43cde1a-9c08-4a6a-9492-ecc277ec8612-agent-certs\") pod \"konnectivity-agent-75qhw\" (UID: \"f43cde1a-9c08-4a6a-9492-ecc277ec8612\") " pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:02.985704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dbaa831-e640-4995-aa01-71d1286ee59f-serviceca\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:02.985704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prm4\" (UniqueName: \"kubernetes.io/projected/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-kube-api-access-5prm4\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985856 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8g5\" (UniqueName: \"kubernetes.io/projected/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-kube-api-access-hc8g5\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:02.985856 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysctl-d\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985856 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12877bea-aec9-4962-b0ea-53657adcb9e1-dbus\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:02.985856 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysctl-conf\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.985856 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2psl9\" (UniqueName: \"kubernetes.io/projected/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-kube-api-access-2psl9\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:02.985856 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:02.986138 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-iptables-alerter-script\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:02.986138 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.985874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-kubernetes\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:02.986266 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.986244 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:02.986582 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.986562 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 03:18:02.987204 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.987181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.987305 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.987229 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 03:18:02.987368 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.987311 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 03:18:02.987854 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.987834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 03:18:02.987934 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.987859 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x2p8x\"" Jun 15 03:18:02.988086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.988067 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.988940 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.988866 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 03:18:02.989942 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.989922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5lrgw\"" Jun 15 03:18:02.990272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:02.990162 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 03:18:03.006544 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.006517 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dt7xh" Jun 15 03:18:03.014322 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.014299 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dt7xh" Jun 15 03:18:03.074427 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.074400 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 03:18:03.086821 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.086790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:03.086956 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.086829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-log-socket\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.086956 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.086852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.086956 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.086919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.087113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.086969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6afea764-6a01-4e6c-a431-4f39675daa82-tmp-dir\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.087113 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.086991 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:03.087113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.086996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-os-release\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.087113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-host-slash\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.087113 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.087079 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:03.587042048 +0000 UTC m=+3.031236732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:03.087113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-slash\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-host-slash\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-systemd\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-cnibin\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-cni-bin\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dbaa831-e640-4995-aa01-71d1286ee59f-host\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-modprobe-d\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-systemd\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-tuned\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-os-release\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-systemd\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dbaa831-e640-4995-aa01-71d1286ee59f-host\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.087395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79663e0e-89d9-4645-bb97-c0a037160592-cni-binary-copy\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-multus-certs\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087428 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-modprobe-d\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-696dl\" (UniqueName: \"kubernetes.io/projected/ce6a63ad-ee47-40fc-80ee-afc141091523-kube-api-access-696dl\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp9jn\" (UniqueName: \"kubernetes.io/projected/6dbaa831-e640-4995-aa01-71d1286ee59f-kube-api-access-fp9jn\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-run\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-lib-modules\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-systemd-units\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce6a63ad-ee47-40fc-80ee-afc141091523-ovn-node-metrics-cert\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.087612 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-sys-fs\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f43cde1a-9c08-4a6a-9492-ecc277ec8612-konnectivity-ca\") pod \"konnectivity-agent-75qhw\" (UID: \"f43cde1a-9c08-4a6a-9492-ecc277ec8612\") " pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-ovn\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087675 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-ovnkube-config\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.087754 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:03.587732479 +0000 UTC m=+3.031927178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:03.087894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-env-overrides\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-socket-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-lib-modules\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-run\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-device-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgx5\" (UniqueName: \"kubernetes.io/projected/6afea764-6a01-4e6c-a431-4f39675daa82-kube-api-access-9cgx5\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-cni-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f43cde1a-9c08-4a6a-9492-ecc277ec8612-agent-certs\") pod \"konnectivity-agent-75qhw\" (UID: \"f43cde1a-9c08-4a6a-9492-ecc277ec8612\") " pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dbaa831-e640-4995-aa01-71d1286ee59f-serviceca\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.087999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prm4\" (UniqueName: \"kubernetes.io/projected/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-kube-api-access-5prm4\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-kubelet\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8g5\" (UniqueName: \"kubernetes.io/projected/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-kube-api-access-hc8g5\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-run-netns\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-cni-netd\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-registration-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgvg\" (UniqueName: \"kubernetes.io/projected/c6ca3a97-621e-4ad1-a41e-bee855b7f225-kube-api-access-kkgvg\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-kubelet\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.088751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12877bea-aec9-4962-b0ea-53657adcb9e1-dbus\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-ovnkube-script-lib\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f43cde1a-9c08-4a6a-9492-ecc277ec8612-konnectivity-ca\") pod \"konnectivity-agent-75qhw\" (UID: \"f43cde1a-9c08-4a6a-9492-ecc277ec8612\") " pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-system-cni-dir\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088349 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12877bea-aec9-4962-b0ea-53657adcb9e1-dbus\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-system-cni-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-conf-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dbaa831-e640-4995-aa01-71d1286ee59f-serviceca\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2psl9\" (UniqueName: \"kubernetes.io/projected/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-kube-api-access-2psl9\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-iptables-alerter-script\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-kubernetes\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088531 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-etc-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088589 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-kubernetes\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79663e0e-89d9-4645-bb97-c0a037160592-multus-daemon-config\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-host\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6afea764-6a01-4e6c-a431-4f39675daa82-hosts-file\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-netns\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.089549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-host\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-cnibin\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-sys\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-var-lib-kubelet\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-sys\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12877bea-aec9-4962-b0ea-53657adcb9e1-kubelet-config\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysconfig\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-var-lib-kubelet\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-tmp\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysconfig\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.088997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12877bea-aec9-4962-b0ea-53657adcb9e1-kubelet-config\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-iptables-alerter-script\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-etc-kubernetes\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.090379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfz5\" (UniqueName: \"kubernetes.io/projected/79663e0e-89d9-4645-bb97-c0a037160592-kube-api-access-vdfz5\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-var-lib-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-node-log\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbgh\" (UniqueName: \"kubernetes.io/projected/d2bc74ab-7038-489a-b029-e35b3742632b-kube-api-access-kcbgh\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-k8s-cni-cncf-io\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysctl-d\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-cni-bin\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysctl-conf\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysctl-d\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-run-ovn-kubernetes\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-sysctl-conf\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-socket-dir-parent\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-cni-multus\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.091180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.089594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-hostroot\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.091892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.091438 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-etc-tuned\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.091892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.091653 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f43cde1a-9c08-4a6a-9492-ecc277ec8612-agent-certs\") pod \"konnectivity-agent-75qhw\" (UID: \"f43cde1a-9c08-4a6a-9492-ecc277ec8612\") " pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:03.091962 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.091917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-tmp\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.094830 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.094810 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:03.094937 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.094834 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:03.094937 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.094849 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:03.094937 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.094918 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:03.59489916 +0000 UTC m=+3.039093844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:03.096963 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.096941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8g5\" (UniqueName: \"kubernetes.io/projected/093e0ed7-e2f4-4e18-b9c6-5425d9066c85-kube-api-access-hc8g5\") pod \"iptables-alerter-hfd4h\" (UID: \"093e0ed7-e2f4-4e18-b9c6-5425d9066c85\") " pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.098000 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.097943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prm4\" (UniqueName: \"kubernetes.io/projected/72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc-kube-api-access-5prm4\") pod \"tuned-4dwsr\" (UID: \"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc\") " pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.098714 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.098693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2psl9\" (UniqueName: \"kubernetes.io/projected/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-kube-api-access-2psl9\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:03.099555 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.099534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp9jn\" (UniqueName: \"kubernetes.io/projected/6dbaa831-e640-4995-aa01-71d1286ee59f-kube-api-access-fp9jn\") pod \"node-ca-77tnc\" (UID: \"6dbaa831-e640-4995-aa01-71d1286ee59f\") " pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.190610 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-env-overrides\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.190770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-socket-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.190770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-device-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.190770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-device-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.190770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgx5\" (UniqueName: \"kubernetes.io/projected/6afea764-6a01-4e6c-a431-4f39675daa82-kube-api-access-9cgx5\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-cni-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-kubelet\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-run-netns\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-cni-netd\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-registration-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190897 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-socket-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgvg\" (UniqueName: \"kubernetes.io/projected/c6ca3a97-621e-4ad1-a41e-bee855b7f225-kube-api-access-kkgvg\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.190964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-kubelet\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.190984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-ovnkube-script-lib\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-system-cni-dir\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-system-cni-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-conf-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191079 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-env-overrides\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-etc-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79663e0e-89d9-4645-bb97-c0a037160592-multus-daemon-config\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191130 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-kubelet\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6afea764-6a01-4e6c-a431-4f39675daa82-hosts-file\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-run-netns\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-netns\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6afea764-6a01-4e6c-a431-4f39675daa82-hosts-file\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-cni-netd\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-system-cni-dir\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-cnibin\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-registration-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-kubelet\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-conf-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-cni-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-system-cni-dir\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-cnibin\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191388 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-netns\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.191914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-etc-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-ovnkube-script-lib\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.191943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79663e0e-89d9-4645-bb97-c0a037160592-multus-daemon-config\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-etc-kubernetes\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfz5\" (UniqueName: \"kubernetes.io/projected/79663e0e-89d9-4645-bb97-c0a037160592-kube-api-access-vdfz5\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-var-lib-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-etc-kubernetes\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-node-log\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbgh\" (UniqueName: \"kubernetes.io/projected/d2bc74ab-7038-489a-b029-e35b3742632b-kube-api-access-kcbgh\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-k8s-cni-cncf-io\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192296 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-k8s-cni-cncf-io\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-node-log\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-var-lib-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-cni-bin\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-cni-bin\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-run-ovn-kubernetes\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192465 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-openvswitch\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-socket-dir-parent\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192502 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-run-ovn-kubernetes\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-cni-multus\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-hostroot\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-log-socket\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-multus-socket-dir-parent\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.192892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6afea764-6a01-4e6c-a431-4f39675daa82-tmp-dir\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-cni-multus\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-os-release\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-slash\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-hostroot\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192724 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-systemd\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-cnibin\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-log-socket\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-cni-bin\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192783 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-var-lib-cni-bin\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-os-release\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79663e0e-89d9-4645-bb97-c0a037160592-cni-binary-copy\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-multus-certs\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-696dl\" (UniqueName: \"kubernetes.io/projected/ce6a63ad-ee47-40fc-80ee-afc141091523-kube-api-access-696dl\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-systemd-units\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.193696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce6a63ad-ee47-40fc-80ee-afc141091523-ovn-node-metrics-cert\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-sys-fs\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-ovn\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-ovnkube-config\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.192956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2bc74ab-7038-489a-b029-e35b3742632b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-systemd\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6ca3a97-621e-4ad1-a41e-bee855b7f225-sys-fs\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193064 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2bc74ab-7038-489a-b029-e35b3742632b-os-release\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193082 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-run-ovn\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-cnibin\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-systemd-units\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-host-run-multus-certs\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193251 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79663e0e-89d9-4645-bb97-c0a037160592-cni-binary-copy\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193296 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79663e0e-89d9-4645-bb97-c0a037160592-os-release\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce6a63ad-ee47-40fc-80ee-afc141091523-host-slash\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6afea764-6a01-4e6c-a431-4f39675daa82-tmp-dir\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.194355 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.193641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce6a63ad-ee47-40fc-80ee-afc141091523-ovnkube-config\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.195334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.195303 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce6a63ad-ee47-40fc-80ee-afc141091523-ovn-node-metrics-cert\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.202322 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.202272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbgh\" (UniqueName: \"kubernetes.io/projected/d2bc74ab-7038-489a-b029-e35b3742632b-kube-api-access-kcbgh\") pod \"multus-additional-cni-plugins-jx2mb\" (UID: \"d2bc74ab-7038-489a-b029-e35b3742632b\") " pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.202513 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.202494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfz5\" (UniqueName: \"kubernetes.io/projected/79663e0e-89d9-4645-bb97-c0a037160592-kube-api-access-vdfz5\") pod \"multus-sj4vt\" (UID: \"79663e0e-89d9-4645-bb97-c0a037160592\") " pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.202749 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.202731 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgx5\" (UniqueName: \"kubernetes.io/projected/6afea764-6a01-4e6c-a431-4f39675daa82-kube-api-access-9cgx5\") pod \"node-resolver-757bh\" (UID: \"6afea764-6a01-4e6c-a431-4f39675daa82\") " pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.202821 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.202760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-696dl\" (UniqueName: \"kubernetes.io/projected/ce6a63ad-ee47-40fc-80ee-afc141091523-kube-api-access-696dl\") pod \"ovnkube-node-lnxn5\" (UID: \"ce6a63ad-ee47-40fc-80ee-afc141091523\") " pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.202869 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.202824 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgvg\" (UniqueName: \"kubernetes.io/projected/c6ca3a97-621e-4ad1-a41e-bee855b7f225-kube-api-access-kkgvg\") pod \"aws-ebs-csi-driver-node-mnwg2\" (UID: \"c6ca3a97-621e-4ad1-a41e-bee855b7f225\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.273673 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.273639 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfd4h" Jun 15 03:18:03.280114 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.280095 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-77tnc" Jun 15 03:18:03.288718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.288699 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:03.295426 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.295407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" Jun 15 03:18:03.302051 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.302034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" Jun 15 03:18:03.309568 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.309551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sj4vt" Jun 15 03:18:03.316211 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.316192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:03.322767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.322751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" Jun 15 03:18:03.328385 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.328371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-757bh" Jun 15 03:18:03.469127 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.469060 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:18:03.594788 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.594760 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:03.594944 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.594797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:03.594944 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.594927 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:03.595043 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.594995 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:04.594975 +0000 UTC m=+4.039169701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:03.595043 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.594931 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:03.595125 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.595046 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:04.595035828 +0000 UTC m=+4.039230527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:03.695341 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:03.695314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:03.695487 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.695459 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:03.695487 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.695480 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:03.695487 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.695489 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:03.695605 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:03.695541 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:04.695527368 +0000 UTC m=+4.139722071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:03.815101 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.815074 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbaa831_e640_4995_aa01_71d1286ee59f.slice/crio-4323bb5f31cc31efc958a47ede6ea4008d1a46331bebfc66de8689669d10a8eb WatchSource:0}: Error finding container 4323bb5f31cc31efc958a47ede6ea4008d1a46331bebfc66de8689669d10a8eb: Status 404 returned error can't find the container with id 4323bb5f31cc31efc958a47ede6ea4008d1a46331bebfc66de8689669d10a8eb Jun 15 03:18:03.816164 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.816127 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093e0ed7_e2f4_4e18_b9c6_5425d9066c85.slice/crio-af4a64253ab48dd88d6e0da800a77ed969550505dd48756e80972617dc87f152 WatchSource:0}: Error finding container af4a64253ab48dd88d6e0da800a77ed969550505dd48756e80972617dc87f152: Status 404 returned error can't find the container with id af4a64253ab48dd88d6e0da800a77ed969550505dd48756e80972617dc87f152 Jun 15 03:18:03.816827 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.816801 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43cde1a_9c08_4a6a_9492_ecc277ec8612.slice/crio-7a738c433ff00d38c78814ba4e1e11df4c4f0f7ceadf5b2aeb38fac8d24e18c4 WatchSource:0}: Error finding container 7a738c433ff00d38c78814ba4e1e11df4c4f0f7ceadf5b2aeb38fac8d24e18c4: Status 404 returned error can't find the container with id 7a738c433ff00d38c78814ba4e1e11df4c4f0f7ceadf5b2aeb38fac8d24e18c4 Jun 15 03:18:03.818528 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.818509 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ca3a97_621e_4ad1_a41e_bee855b7f225.slice/crio-57117aceedc6b7b5c86b0e26f2cae5163978e8fd77738035f98c147a36f599ae WatchSource:0}: Error finding container 57117aceedc6b7b5c86b0e26f2cae5163978e8fd77738035f98c147a36f599ae: Status 404 returned error can't find the container with id 57117aceedc6b7b5c86b0e26f2cae5163978e8fd77738035f98c147a36f599ae Jun 15 03:18:03.841594 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.841563 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6a63ad_ee47_40fc_80ee_afc141091523.slice/crio-94976599b3d284103dc17b5a070a238733516808023a5541cad120c2ebe843d3 WatchSource:0}: Error finding container 94976599b3d284103dc17b5a070a238733516808023a5541cad120c2ebe843d3: Status 404 returned error can't find the container with id 94976599b3d284103dc17b5a070a238733516808023a5541cad120c2ebe843d3 Jun 15 03:18:03.842312 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.842291 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afea764_6a01_4e6c_a431_4f39675daa82.slice/crio-f501f5fe6b5b9eb307666da338e79c5296161b75ccc621fcf4fe7ada78c401d6 WatchSource:0}: Error finding container f501f5fe6b5b9eb307666da338e79c5296161b75ccc621fcf4fe7ada78c401d6: Status 404 returned error can't find the container with id f501f5fe6b5b9eb307666da338e79c5296161b75ccc621fcf4fe7ada78c401d6 Jun 15 03:18:03.843350 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.843329 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79663e0e_89d9_4645_bb97_c0a037160592.slice/crio-a2dc95caab474ccedd90a6b95658a39b1662b108dd8cd07666d4b91a880d4552 WatchSource:0}: Error finding container a2dc95caab474ccedd90a6b95658a39b1662b108dd8cd07666d4b91a880d4552: Status 404 returned error can't find the container with id a2dc95caab474ccedd90a6b95658a39b1662b108dd8cd07666d4b91a880d4552 Jun 15 03:18:03.844569 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.844479 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d7a210_e8e0_4d31_b2ea_77e8b5a91cbc.slice/crio-6fc3d33905a5964095683a59f0f88c6e6b7deae178e59aba18bc1ac6ffababc6 WatchSource:0}: Error finding container 6fc3d33905a5964095683a59f0f88c6e6b7deae178e59aba18bc1ac6ffababc6: Status 404 returned error can't find the container with id 6fc3d33905a5964095683a59f0f88c6e6b7deae178e59aba18bc1ac6ffababc6 Jun 15 03:18:03.846198 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:03.846177 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bc74ab_7038_489a_b029_e35b3742632b.slice/crio-c2badb93b1170d2f7dde45d6897d1e457707baed3b6a84b614995c240f9cf8ab WatchSource:0}: Error finding container c2badb93b1170d2f7dde45d6897d1e457707baed3b6a84b614995c240f9cf8ab: Status 404 returned error can't find the container with id c2badb93b1170d2f7dde45d6897d1e457707baed3b6a84b614995c240f9cf8ab Jun 15 03:18:04.017562 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.017513 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 03:13:03 +0000 UTC" deadline="2028-02-03 11:07:30.860981575 +0000 UTC" Jun 15 03:18:04.017562 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.017558 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14359h49m26.843426332s" Jun 15 03:18:04.050256 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.050179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" event={"ID":"c6ca3a97-621e-4ad1-a41e-bee855b7f225","Type":"ContainerStarted","Data":"57117aceedc6b7b5c86b0e26f2cae5163978e8fd77738035f98c147a36f599ae"} Jun 15 03:18:04.051291 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.051264 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfd4h" event={"ID":"093e0ed7-e2f4-4e18-b9c6-5425d9066c85","Type":"ContainerStarted","Data":"af4a64253ab48dd88d6e0da800a77ed969550505dd48756e80972617dc87f152"} Jun 15 03:18:04.052453 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.052425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerStarted","Data":"c2badb93b1170d2f7dde45d6897d1e457707baed3b6a84b614995c240f9cf8ab"} Jun 15 03:18:04.053668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.053636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" event={"ID":"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc","Type":"ContainerStarted","Data":"6fc3d33905a5964095683a59f0f88c6e6b7deae178e59aba18bc1ac6ffababc6"} Jun 15 03:18:04.055089 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.055064 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sj4vt" event={"ID":"79663e0e-89d9-4645-bb97-c0a037160592","Type":"ContainerStarted","Data":"a2dc95caab474ccedd90a6b95658a39b1662b108dd8cd07666d4b91a880d4552"} Jun 15 03:18:04.056100 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.056074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-757bh" event={"ID":"6afea764-6a01-4e6c-a431-4f39675daa82","Type":"ContainerStarted","Data":"f501f5fe6b5b9eb307666da338e79c5296161b75ccc621fcf4fe7ada78c401d6"} Jun 15 03:18:04.057217 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.057181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75qhw" event={"ID":"f43cde1a-9c08-4a6a-9492-ecc277ec8612","Type":"ContainerStarted","Data":"7a738c433ff00d38c78814ba4e1e11df4c4f0f7ceadf5b2aeb38fac8d24e18c4"} Jun 15 03:18:04.058523 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.058504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-77tnc" event={"ID":"6dbaa831-e640-4995-aa01-71d1286ee59f","Type":"ContainerStarted","Data":"4323bb5f31cc31efc958a47ede6ea4008d1a46331bebfc66de8689669d10a8eb"} Jun 15 03:18:04.060381 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.060360 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" event={"ID":"bbce36964cb706e702654efc4cca68d1","Type":"ContainerStarted","Data":"7c83d198cbc5f36d264b2124a96c7a50017ba9cb76da676f0aca5c043d85b5ee"} Jun 15 03:18:04.061497 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.061477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"94976599b3d284103dc17b5a070a238733516808023a5541cad120c2ebe843d3"} Jun 15 03:18:04.075070 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.075034 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-131.ec2.internal" podStartSLOduration=2.075016765 podStartE2EDuration="2.075016765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:04.074784749 +0000 UTC m=+3.518979456" watchObservedRunningTime="2026-06-15 03:18:04.075016765 +0000 UTC m=+3.519211470" Jun 15 03:18:04.604388 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.603644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:04.604388 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.603705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:04.604388 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.603834 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:04.604388 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.603895 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:06.603877065 +0000 UTC m=+6.048071767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:04.604388 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.604311 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:04.604388 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.604355 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:06.604341486 +0000 UTC m=+6.048536175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:04.704328 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:04.704289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:04.704516 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.704492 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:04.704516 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.704515 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:04.704639 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.704529 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:04.704639 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:04.704588 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:06.704570305 +0000 UTC m=+6.148764995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:05.017912 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.017867 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 03:13:03 +0000 UTC" deadline="2028-03-24 11:04:43.01127266 +0000 UTC" Jun 15 03:18:05.017912 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.017910 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15559h46m37.993368461s" Jun 15 03:18:05.043802 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.043776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:05.043952 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:05.043907 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:05.044320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.044296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:05.044418 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:05.044399 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:05.044494 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.044459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:05.044547 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:05.044520 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:05.086188 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.086120 2559 generic.go:356] "Generic (PLEG): container finished" podID="f9144b803da67fa3f191cfe3efc11199" containerID="cd45a762e1424c7e3d675da26d525b5fe67e7ee30c78aae944eef0fab70ed8e0" exitCode=0 Jun 15 03:18:05.086188 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:05.086179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" event={"ID":"f9144b803da67fa3f191cfe3efc11199","Type":"ContainerDied","Data":"cd45a762e1424c7e3d675da26d525b5fe67e7ee30c78aae944eef0fab70ed8e0"} Jun 15 03:18:06.101522 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:06.101237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" event={"ID":"f9144b803da67fa3f191cfe3efc11199","Type":"ContainerStarted","Data":"521f3c21edd3801c82d851da0a7e0e6cb707c79eea9ed52a4ba69f9ec6acbb26"} Jun 15 03:18:06.617518 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:06.617482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:06.617718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:06.617536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:06.617718 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.617660 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:06.617718 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.617720 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:10.61770155 +0000 UTC m=+10.061896238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:06.618100 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.618080 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:06.618186 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.618132 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:10.618118621 +0000 UTC m=+10.062313312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:06.718007 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:06.717910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:06.718171 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.718115 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:06.718171 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.718136 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:06.718171 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.718164 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:06.718329 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:06.718224 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:10.718206351 +0000 UTC m=+10.162401054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:07.042198 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:07.041641 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:07.042198 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:07.041757 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:07.042198 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:07.041810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:07.042198 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:07.041920 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:07.042198 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:07.041980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:07.042198 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:07.042072 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:09.041379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:09.041345 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:09.041806 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:09.041360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:09.041806 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:09.041484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:09.041806 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:09.041536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:09.041806 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:09.041612 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:09.041806 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:09.041679 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:10.650414 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:10.650381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:10.650895 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:10.650464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:10.650895 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.650513 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:10.650895 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.650541 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:10.650895 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.650570 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:18.65055424 +0000 UTC m=+18.094748936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:10.650895 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.650589 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:18.650580006 +0000 UTC m=+18.094774693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:10.751451 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:10.751392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:10.751635 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.751581 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:10.751635 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.751605 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:10.751635 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.751617 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:10.751793 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:10.751682 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:18.751664673 +0000 UTC m=+18.195859361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:11.042586 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:11.042507 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:11.042756 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:11.042608 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:11.042756 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:11.042670 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:11.042870 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:11.042785 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:11.042870 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:11.042831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:11.042954 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:11.042900 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:13.041518 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:13.041483 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:13.041969 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:13.041493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:13.041969 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:13.041621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:13.041969 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:13.041612 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:13.041969 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:13.041750 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:13.041969 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:13.041860 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:15.041107 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:15.041075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:15.041611 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:15.041075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:15.041611 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:15.041207 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:15.041611 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:15.041243 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:15.041611 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:15.041075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:15.041611 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:15.041338 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:17.041629 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:17.041597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:17.042064 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:17.041700 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:17.042064 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:17.041746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:17.042064 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:17.041599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:17.042064 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:17.041833 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:17.042064 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:17.042010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:18.715803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:18.715772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:18.715803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:18.715815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:18.716283 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.715921 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:18.716283 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.715939 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:18.716283 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.715979 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:34.715964133 +0000 UTC m=+34.160158817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:18.716283 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.716002 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:34.715984808 +0000 UTC m=+34.160179497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:18.816933 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:18.816903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:18.817101 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.817016 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:18.817101 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.817032 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:18.817101 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.817045 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:18.817101 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:18.817088 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:34.817076685 +0000 UTC m=+34.261271369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:19.041095 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:19.041058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:19.041095 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:19.041081 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:19.041390 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:19.041208 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:19.041390 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:19.041298 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:19.041390 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:19.041356 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:19.041551 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:19.041452 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:21.042174 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:21.042065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:21.042767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:21.042189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:21.042767 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:21.042196 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:21.042767 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:21.042348 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:21.042767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:21.042414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:21.042767 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:21.042481 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:23.042057 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.041861 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:23.042675 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.041866 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:23.042675 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.041907 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:23.042675 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:23.042333 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:23.042675 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:23.042100 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:23.042675 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:23.042412 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:23.134627 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.134604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:18:23.134957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.134938 2559 generic.go:356] "Generic (PLEG): container finished" podID="ce6a63ad-ee47-40fc-80ee-afc141091523" containerID="c23398a0fa866c771125f69c77566bd1d809e75b61f7f9bf480f86a74e11716a" exitCode=1 Jun 15 03:18:23.135034 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.135013 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"6ea19ea6e3e9ecd38622d96dd7b7de6ede8ae15b25b0508409f13fafd3d29682"} Jun 15 03:18:23.135115 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.135096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"69ac361a4287fd8ee789b57c9794f91a0ee59f2dc4b9db95a232ada204d20d9a"} Jun 15 03:18:23.135249 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.135175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"ae46cb9da3199896120a31b1f7347e64cecbee2f9e4989f65b7d5ca92dc50281"} Jun 15 03:18:23.135249 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.135225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"2996930b47c5ba27f1c3484314978beaf8afe794e21e171a6110df5b9e287bd9"} Jun 15 03:18:23.135356 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.135266 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerDied","Data":"c23398a0fa866c771125f69c77566bd1d809e75b61f7f9bf480f86a74e11716a"} Jun 15 03:18:23.135356 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.135310 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"fdb8460ef7273f4a950d5a6bb4db91f3d033b6fe4f4d81d3f7acea410e2f0929"} Jun 15 03:18:23.136537 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.136515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" event={"ID":"c6ca3a97-621e-4ad1-a41e-bee855b7f225","Type":"ContainerStarted","Data":"dbdc2d42c2c6c865baa27ff8dbefc46ca882ff3db3710b63facf5c6e9870b4de"} Jun 15 03:18:23.137952 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.137931 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2bc74ab-7038-489a-b029-e35b3742632b" containerID="ae86010cc40a6018c3c8de05575e4c8c343df73a46da51ec93cde12e12d74ff6" exitCode=0 Jun 15 03:18:23.138051 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.138000 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerDied","Data":"ae86010cc40a6018c3c8de05575e4c8c343df73a46da51ec93cde12e12d74ff6"} Jun 15 03:18:23.139443 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.139405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" event={"ID":"72d7a210-e8e0-4d31-b2ea-77e8b5a91cbc","Type":"ContainerStarted","Data":"7dd1d413a7c93275c9805a095a71fc7fc4805a61ee71693e493e62e9997e91b8"} Jun 15 03:18:23.140975 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.140954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sj4vt" event={"ID":"79663e0e-89d9-4645-bb97-c0a037160592","Type":"ContainerStarted","Data":"a8a1c904b5667b963c738f3221e8529b1d5b3ab72cd07dca3ecb20d7e7e3e0b7"} Jun 15 03:18:23.142315 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.142298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-757bh" event={"ID":"6afea764-6a01-4e6c-a431-4f39675daa82","Type":"ContainerStarted","Data":"b7161d1c82a9874f81897074edcd50401fd642668a068376f71b96871d97d3a0"} Jun 15 03:18:23.143634 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.143615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75qhw" event={"ID":"f43cde1a-9c08-4a6a-9492-ecc277ec8612","Type":"ContainerStarted","Data":"9e63ce7d638991365179d7e0d6b98ae2d597fea8231160547eb7e602d13319a5"} Jun 15 03:18:23.145097 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.145069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-77tnc" event={"ID":"6dbaa831-e640-4995-aa01-71d1286ee59f","Type":"ContainerStarted","Data":"e20a8eb015ba056f0e75d76123052ad79d2d6ab5a09443161c32065b37044ef3"} Jun 15 03:18:23.160274 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.160229 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-131.ec2.internal" podStartSLOduration=21.160216374 podStartE2EDuration="21.160216374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:06.117891156 +0000 UTC m=+5.562085863" watchObservedRunningTime="2026-06-15 03:18:23.160216374 +0000 UTC m=+22.604411078" Jun 15 03:18:23.177592 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.177556 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sj4vt" podStartSLOduration=3.793454209 podStartE2EDuration="22.177548647s" totalImagesPullingTime="18.384094438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:23.177224396 +0000 UTC m=+22.621419113" watchObservedRunningTime="2026-06-15 03:18:23.177548647 +0000 UTC m=+22.621743352" Jun 15 03:18:23.192930 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.192892 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-757bh" podStartSLOduration=3.815088593 podStartE2EDuration="22.192880599s" totalImagesPullingTime="18.377792006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:23.192872333 +0000 UTC m=+22.637067039" watchObservedRunningTime="2026-06-15 03:18:23.192880599 +0000 UTC m=+22.637075305" Jun 15 03:18:23.208127 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.208097 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-77tnc" podStartSLOduration=3.83077174 podStartE2EDuration="22.20808517s" totalImagesPullingTime="18.37731343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:23.207743923 +0000 UTC m=+22.651938633" watchObservedRunningTime="2026-06-15 03:18:23.20808517 +0000 UTC m=+22.652279875" Jun 15 03:18:23.226237 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.226192 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-75qhw" podStartSLOduration=8.536978152 podStartE2EDuration="22.226174529s" totalImagesPullingTime="13.689196377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:23.225749696 +0000 UTC m=+22.669944401" watchObservedRunningTime="2026-06-15 03:18:23.226174529 +0000 UTC m=+22.670369236" Jun 15 03:18:23.881102 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:23.881076 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 03:18:24.054739 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.054573 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T03:18:23.881096843Z","UUID":"c0de703b-585d-419a-9eb6-a71e1949de83","Handler":null,"Name":"","Endpoint":""} Jun 15 03:18:24.056115 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.056086 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 03:18:24.056237 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.056125 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 03:18:24.149384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.149028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" event={"ID":"c6ca3a97-621e-4ad1-a41e-bee855b7f225","Type":"ContainerStarted","Data":"63af32cbb7ce3dda0a0b9bcb49625b7b80af4117308ebf0df2e5eb0dfbabb101"} Jun 15 03:18:24.150753 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.150716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfd4h" event={"ID":"093e0ed7-e2f4-4e18-b9c6-5425d9066c85","Type":"ContainerStarted","Data":"a5156445209ba1b8005d623efd01e2f146651ea6965b175c29117028ce4bfd33"} Jun 15 03:18:24.165815 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.165768 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4dwsr" podStartSLOduration=4.786231716 podStartE2EDuration="23.165750244s" totalImagesPullingTime="18.379518528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:23.249866904 +0000 UTC m=+22.694061609" watchObservedRunningTime="2026-06-15 03:18:24.165750244 +0000 UTC m=+23.609944950" Jun 15 03:18:24.166051 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:24.166015 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hfd4h" podStartSLOduration=4.7895630780000005 podStartE2EDuration="23.166008214s" totalImagesPullingTime="18.376445136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:24.165603149 +0000 UTC m=+23.609797854" watchObservedRunningTime="2026-06-15 03:18:24.166008214 +0000 UTC m=+23.610202922" Jun 15 03:18:25.041423 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.041393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:25.041540 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:25.041506 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:25.041540 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.041399 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:25.041540 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.041531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:25.041708 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:25.041600 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:25.041708 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:25.041660 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:25.155129 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.155102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" event={"ID":"c6ca3a97-621e-4ad1-a41e-bee855b7f225","Type":"ContainerStarted","Data":"4c1c21b623933a4246f5ee6ca5a141dafee28ae30c582fd80a19fc3ecf47ee99"} Jun 15 03:18:25.172935 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.172884 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnwg2" podStartSLOduration=3.623024294 podStartE2EDuration="24.172863794s" totalImagesPullingTime="20.5498395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:25.171707351 +0000 UTC m=+24.615902058" watchObservedRunningTime="2026-06-15 03:18:25.172863794 +0000 UTC m=+24.617058501" Jun 15 03:18:25.798595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.798560 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:25.799766 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:25.799746 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:26.161089 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:26.161056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:18:26.161655 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:26.161551 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"4a7b55d7b1cbb1226f90294da16cabd4ab04a589d60624e58ffa54b7ca01de86"} Jun 15 03:18:26.161924 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:26.161884 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:26.162427 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:26.162406 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-75qhw" Jun 15 03:18:27.041773 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:27.041746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:27.041773 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:27.041758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:27.041994 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:27.041749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:27.041994 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:27.041868 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:27.041994 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:27.041921 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:27.042127 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:27.042035 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:28.167996 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.167810 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2bc74ab-7038-489a-b029-e35b3742632b" containerID="e3a2aa34adf24265f7aca220e71269ebcac232e63eb57346f74cb4db9fb57939" exitCode=0 Jun 15 03:18:28.168452 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.167895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerDied","Data":"e3a2aa34adf24265f7aca220e71269ebcac232e63eb57346f74cb4db9fb57939"} Jun 15 03:18:28.171892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.171866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:18:28.172368 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.172277 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"6bfca47f21344b9a7bf9aed51282e57367be03363388d4a3898a7c87527ae870"} Jun 15 03:18:28.172551 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.172531 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:28.172635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.172608 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:28.172747 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.172725 2559 scope.go:117] "RemoveContainer" containerID="c23398a0fa866c771125f69c77566bd1d809e75b61f7f9bf480f86a74e11716a" Jun 15 03:18:28.189777 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:28.189759 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:29.041458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.041240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:29.041581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.041282 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:29.041581 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:29.041545 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:29.041690 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:29.041602 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:29.041690 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.041315 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:29.041690 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:29.041672 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:29.177649 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.177591 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:18:29.178159 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.177953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" event={"ID":"ce6a63ad-ee47-40fc-80ee-afc141091523","Type":"ContainerStarted","Data":"291c6f819ad1c218f731746df93e85adcaaf65b0e25a84804e896fc3a229c4da"} Jun 15 03:18:29.178239 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.178165 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:29.180197 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.180168 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2bc74ab-7038-489a-b029-e35b3742632b" containerID="af3c916ed2057b7520293fc597de810e50eb65d580f42a29b52668fee1647f83" exitCode=0 Jun 15 03:18:29.180291 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.180217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerDied","Data":"af3c916ed2057b7520293fc597de810e50eb65d580f42a29b52668fee1647f83"} Jun 15 03:18:29.192304 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.192283 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:18:29.204037 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.203998 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" podStartSLOduration=9.777274836 podStartE2EDuration="28.20398607s" totalImagesPullingTime="18.426711234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:29.203557626 +0000 UTC m=+28.647752365" watchObservedRunningTime="2026-06-15 03:18:29.20398607 +0000 UTC m=+28.648180775" Jun 15 03:18:29.355456 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.355426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfmcz"] Jun 15 03:18:29.355590 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.355578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:29.355693 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:29.355669 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:29.358631 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.358593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s79jd"] Jun 15 03:18:29.358766 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.358701 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:29.358828 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:29.358808 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:29.359232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.359207 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v4hp7"] Jun 15 03:18:29.359319 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:29.359292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:29.359419 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:29.359385 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:30.184462 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:30.184424 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2bc74ab-7038-489a-b029-e35b3742632b" containerID="4f0058c2ad9b5c6fd2983bc74ac922ee12b19f67a5933170e0dd3be8f09204c1" exitCode=0 Jun 15 03:18:30.184880 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:30.184513 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerDied","Data":"4f0058c2ad9b5c6fd2983bc74ac922ee12b19f67a5933170e0dd3be8f09204c1"} Jun 15 03:18:31.042240 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:31.042210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:31.042412 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:31.042307 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:31.042412 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:31.042353 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:31.042531 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:31.042430 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:31.042531 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:31.042469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:31.042628 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:31.042538 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:33.041382 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:33.041350 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:33.041382 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:33.041370 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:33.042020 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:33.041356 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:33.042020 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:33.041484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:33.042020 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:33.041620 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:33.042020 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:33.041694 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:33.493908 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:33.493870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:33.573786 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:33.573756 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:33.626763 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:33.626725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:34.145782 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:34.145750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:34.201933 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:34.201900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:34.738023 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:34.737831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:34.738136 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.738005 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:34.738232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:34.738092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:34.738232 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.738175 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs podName:bb40c396-e41d-4cf3-96a4-f8444b7ab6c2 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:06.738143215 +0000 UTC m=+66.182337904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs") pod "network-metrics-daemon-s79jd" (UID: "bb40c396-e41d-4cf3-96a4-f8444b7ab6c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:34.738232 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.738201 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:34.738354 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.738258 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret podName:12877bea-aec9-4962-b0ea-53657adcb9e1 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:06.738242166 +0000 UTC m=+66.182436850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret") pod "global-pull-secret-syncer-xfmcz" (UID: "12877bea-aec9-4962-b0ea-53657adcb9e1") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:34.839385 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:34.839349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:34.839543 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.839511 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:34.839543 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.839530 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:34.839543 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.839544 2559 projected.go:196] Error preparing data for projected volume kube-api-access-bmt9l for pod openshift-network-diagnostics/network-check-target-v4hp7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:34.839699 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:34.839608 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l podName:cb043e1e-8d84-4e97-9857-07d22f359c98 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:06.8395893 +0000 UTC m=+66.283783997 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmt9l" (UniqueName: "kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l") pod "network-check-target-v4hp7" (UID: "cb043e1e-8d84-4e97-9857-07d22f359c98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:35.041210 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.041131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:35.041210 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.041164 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:35.041413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.041135 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:35.041413 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.041248 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s79jd" podUID="bb40c396-e41d-4cf3-96a4-f8444b7ab6c2" Jun 15 03:18:35.041413 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.041336 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmcz" podUID="12877bea-aec9-4962-b0ea-53657adcb9e1" Jun 15 03:18:35.041413 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.041386 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4hp7" podUID="cb043e1e-8d84-4e97-9857-07d22f359c98" Jun 15 03:18:35.197757 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.197728 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2bc74ab-7038-489a-b029-e35b3742632b" containerID="a8487dc79f38d29241cc8b18c405dc273400fd5548414a5498425e412f7da40d" exitCode=0 Jun 15 03:18:35.198074 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.197789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerDied","Data":"a8487dc79f38d29241cc8b18c405dc273400fd5548414a5498425e412f7da40d"} Jun 15 03:18:35.398077 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.398057 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-131.ec2.internal" event="NodeReady" Jun 15 03:18:35.398213 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.398201 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 03:18:35.479835 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.479714 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gtks7"] Jun 15 03:18:35.493486 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.493466 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7bmdl"] Jun 15 03:18:35.493673 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.493648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.496117 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.496005 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 03:18:35.496117 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.496102 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 03:18:35.496311 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.496167 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w8plj\"" Jun 15 03:18:35.513545 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.513528 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9479b4975-fhkbh"] Jun 15 03:18:35.513670 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.513654 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.516050 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.516034 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 03:18:35.516050 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.516050 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 03:18:35.516230 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.516078 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 03:18:35.516230 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.516176 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvrpc\"" Jun 15 03:18:35.533753 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.533731 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bmdl"] Jun 15 03:18:35.533836 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.533763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gtks7"] Jun 15 03:18:35.533836 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.533788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9479b4975-fhkbh"] Jun 15 03:18:35.533914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.533837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.536579 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.536557 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 03:18:35.536671 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.536586 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 03:18:35.536671 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.536603 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lv6bc\"" Jun 15 03:18:35.536671 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.536592 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 03:18:35.541992 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.541977 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 03:18:35.644093 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.644229 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-installation-pull-secrets\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644229 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea-cert\") pod \"ingress-canary-7bmdl\" (UID: \"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea\") " pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.644229 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-bound-sa-token\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644229 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhbpv\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-kube-api-access-xhbpv\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65f73157-5b8b-48c5-bbeb-2ac9302282eb-config-volume\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.644384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvghl\" (UniqueName: \"kubernetes.io/projected/65f73157-5b8b-48c5-bbeb-2ac9302282eb-kube-api-access-cvghl\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.644384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65f73157-5b8b-48c5-bbeb-2ac9302282eb-tmp-dir\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.644384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-image-registry-private-configuration\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-ca-trust-extracted\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqhzx\" (UniqueName: \"kubernetes.io/projected/e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea-kube-api-access-rqhzx\") pod \"ingress-canary-7bmdl\" (UID: \"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea\") " pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.644581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-certificates\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.644581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.644468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-trusted-ca\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.744896 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.744872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhbpv\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-kube-api-access-xhbpv\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.744989 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.744911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65f73157-5b8b-48c5-bbeb-2ac9302282eb-config-volume\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.744989 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.744927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvghl\" (UniqueName: \"kubernetes.io/projected/65f73157-5b8b-48c5-bbeb-2ac9302282eb-kube-api-access-cvghl\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.744989 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.744947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65f73157-5b8b-48c5-bbeb-2ac9302282eb-tmp-dir\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.744989 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.744972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-image-registry-private-configuration\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-ca-trust-extracted\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqhzx\" (UniqueName: \"kubernetes.io/projected/e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea-kube-api-access-rqhzx\") pod \"ingress-canary-7bmdl\" (UID: \"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea\") " pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.745132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-certificates\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-trusted-ca\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745396 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.745201 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:35.745396 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.745219 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9479b4975-fhkbh: secret "image-registry-tls" not found Jun 15 03:18:35.745396 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.745327 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls podName:e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.245306355 +0000 UTC m=+35.689501053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls") pod "image-registry-9479b4975-fhkbh" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b") : secret "image-registry-tls" not found Jun 15 03:18:35.745396 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65f73157-5b8b-48c5-bbeb-2ac9302282eb-tmp-dir\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.745396 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.745396 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-installation-pull-secrets\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745657 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea-cert\") pod \"ingress-canary-7bmdl\" (UID: \"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea\") " pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.745657 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-bound-sa-token\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745657 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.745496 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:35.745657 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:35.745538 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls podName:65f73157-5b8b-48c5-bbeb-2ac9302282eb nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.245524589 +0000 UTC m=+35.689719276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls") pod "dns-default-gtks7" (UID: "65f73157-5b8b-48c5-bbeb-2ac9302282eb") : secret "dns-default-metrics-tls" not found Jun 15 03:18:35.745657 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-ca-trust-extracted\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745884 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-certificates\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.745938 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.745882 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65f73157-5b8b-48c5-bbeb-2ac9302282eb-config-volume\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.746444 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.746420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-trusted-ca\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.749298 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.749269 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-image-registry-private-configuration\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.749298 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.749286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-installation-pull-secrets\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.749298 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.749294 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea-cert\") pod \"ingress-canary-7bmdl\" (UID: \"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea\") " pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.756703 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.756680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhbpv\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-kube-api-access-xhbpv\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.756966 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.756936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqhzx\" (UniqueName: \"kubernetes.io/projected/e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea-kube-api-access-rqhzx\") pod \"ingress-canary-7bmdl\" (UID: \"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea\") " pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.757276 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.757258 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-bound-sa-token\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:35.757605 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.757592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvghl\" (UniqueName: \"kubernetes.io/projected/65f73157-5b8b-48c5-bbeb-2ac9302282eb-kube-api-access-cvghl\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:35.821113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.821095 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bmdl" Jun 15 03:18:35.995492 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:35.995464 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bmdl"] Jun 15 03:18:35.998940 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:35.998913 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4965bf9_d6c5_4ec1_92f8_24c6e537e2ea.slice/crio-90e9b8d774db53a213b2dbc6193897e965fad78eb03efa5147a4ff4988ac64a0 WatchSource:0}: Error finding container 90e9b8d774db53a213b2dbc6193897e965fad78eb03efa5147a4ff4988ac64a0: Status 404 returned error can't find the container with id 90e9b8d774db53a213b2dbc6193897e965fad78eb03efa5147a4ff4988ac64a0 Jun 15 03:18:36.201812 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:36.201734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bmdl" event={"ID":"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea","Type":"ContainerStarted","Data":"90e9b8d774db53a213b2dbc6193897e965fad78eb03efa5147a4ff4988ac64a0"} Jun 15 03:18:36.205033 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:36.205009 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2bc74ab-7038-489a-b029-e35b3742632b" containerID="9784298661a114a96efbc87c8ab567e6a35134b3b5da36b1791ce3c043a9dd3f" exitCode=0 Jun 15 03:18:36.205132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:36.205058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerDied","Data":"9784298661a114a96efbc87c8ab567e6a35134b3b5da36b1791ce3c043a9dd3f"} Jun 15 03:18:36.249847 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:36.249816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:36.249953 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:36.249879 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:36.249953 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:36.249909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:36.249953 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:36.249915 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9479b4975-fhkbh: secret "image-registry-tls" not found Jun 15 03:18:36.250091 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:36.249966 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls podName:e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:37.249948443 +0000 UTC m=+36.694143144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls") pod "image-registry-9479b4975-fhkbh" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b") : secret "image-registry-tls" not found Jun 15 03:18:36.250091 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:36.250022 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:36.250091 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:36.250069 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls podName:65f73157-5b8b-48c5-bbeb-2ac9302282eb nodeName:}" failed. No retries permitted until 2026-06-15 03:18:37.250052521 +0000 UTC m=+36.694247204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls") pod "dns-default-gtks7" (UID: "65f73157-5b8b-48c5-bbeb-2ac9302282eb") : secret "dns-default-metrics-tls" not found Jun 15 03:18:37.041566 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.041320 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:18:37.041881 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.041330 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:18:37.041881 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.041374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:18:37.044790 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.044767 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 03:18:37.046171 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.045984 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbt26\"" Jun 15 03:18:37.046171 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.046000 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 03:18:37.046171 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.046018 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 03:18:37.046171 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.046071 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9frqx\"" Jun 15 03:18:37.046171 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.045985 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 03:18:37.211405 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.211362 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" event={"ID":"d2bc74ab-7038-489a-b029-e35b3742632b","Type":"ContainerStarted","Data":"3a831a8dff01e871a3168cd5212766f77e129e8bd1349569b2c6c9080292d8c0"} Jun 15 03:18:37.233684 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.233622 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jx2mb" podStartSLOduration=7.817210095 podStartE2EDuration="36.233603536s" totalImagesPullingTime="28.416393441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:37.232876562 +0000 UTC m=+36.677071270" watchObservedRunningTime="2026-06-15 03:18:37.233603536 +0000 UTC m=+36.677798243" Jun 15 03:18:37.257054 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.257032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:37.257184 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.257078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:37.257226 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:37.257197 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:37.257226 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:37.257200 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:37.257226 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:37.257216 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9479b4975-fhkbh: secret "image-registry-tls" not found Jun 15 03:18:37.257318 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:37.257240 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls podName:65f73157-5b8b-48c5-bbeb-2ac9302282eb nodeName:}" failed. No retries permitted until 2026-06-15 03:18:39.257229372 +0000 UTC m=+38.701424055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls") pod "dns-default-gtks7" (UID: "65f73157-5b8b-48c5-bbeb-2ac9302282eb") : secret "dns-default-metrics-tls" not found Jun 15 03:18:37.257318 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:37.257253 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls podName:e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:39.257246845 +0000 UTC m=+38.701441528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls") pod "image-registry-9479b4975-fhkbh" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b") : secret "image-registry-tls" not found Jun 15 03:18:37.353891 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.353813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:37.413042 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:37.413012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.217223 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.217140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bmdl" event={"ID":"e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea","Type":"ContainerStarted","Data":"a68e0a52989fe501a87df573bda076e2c26e907e5f65c488c7d28fbae2465d9a"} Jun 15 03:18:39.234925 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.234877 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7bmdl" podStartSLOduration=2.066345078 podStartE2EDuration="4.234860367s" totalImagesPullingTime="2.168515289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.234691933 +0000 UTC m=+38.678886640" watchObservedRunningTime="2026-06-15 03:18:39.234860367 +0000 UTC m=+38.679055071" Jun 15 03:18:39.271738 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.271715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:39.271847 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.271776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:39.271945 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.271924 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:39.271991 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.271954 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9479b4975-fhkbh: secret "image-registry-tls" not found Jun 15 03:18:39.272026 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.272009 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls podName:e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:43.271991396 +0000 UTC m=+42.716186097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls") pod "image-registry-9479b4975-fhkbh" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b") : secret "image-registry-tls" not found Jun 15 03:18:39.272026 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.271927 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:39.272102 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.272054 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls podName:65f73157-5b8b-48c5-bbeb-2ac9302282eb nodeName:}" failed. No retries permitted until 2026-06-15 03:18:43.272043041 +0000 UTC m=+42.716237724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls") pod "dns-default-gtks7" (UID: "65f73157-5b8b-48c5-bbeb-2ac9302282eb") : secret "dns-default-metrics-tls" not found Jun 15 03:18:39.309385 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.309363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.379113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.379088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.453569 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.453545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.559232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.559178 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.639766 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.639745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.717680 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.717650 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pf8xd"] Jun 15 03:18:39.742452 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.742433 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pf8xd"] Jun 15 03:18:39.742551 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.742525 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.744957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.744937 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 03:18:39.745116 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.744999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.745224 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.745210 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 03:18:39.745224 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.745218 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 03:18:39.745347 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.745237 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 03:18:39.746502 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.746490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fl546\"" Jun 15 03:18:39.802523 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.802498 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:39.875640 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.875601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02f43877-de12-40bb-b526-0bb2565a7943-crio-socket\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.875640 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.875635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whp6d\" (UniqueName: \"kubernetes.io/projected/02f43877-de12-40bb-b526-0bb2565a7943-kube-api-access-whp6d\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.875759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.875669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.875759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.875740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.875861 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.875793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02f43877-de12-40bb-b526-0bb2565a7943-data-volume\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.976185 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.976158 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.976298 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.976204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.976298 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.976233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02f43877-de12-40bb-b526-0bb2565a7943-data-volume\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.976298 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.976278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02f43877-de12-40bb-b526-0bb2565a7943-crio-socket\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.976298 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.976288 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:39.976479 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.976310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whp6d\" (UniqueName: \"kubernetes.io/projected/02f43877-de12-40bb-b526-0bb2565a7943-kube-api-access-whp6d\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.976479 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.976313 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:39.976479 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.976377 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:40.476356138 +0000 UTC m=+39.920550826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : configmap "kube-rbac-proxy" not found Jun 15 03:18:39.976479 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:39.976399 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:40.47638892 +0000 UTC m=+39.920583608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:39.976624 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.976507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02f43877-de12-40bb-b526-0bb2565a7943-crio-socket\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.986429 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.986409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02f43877-de12-40bb-b526-0bb2565a7943-data-volume\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:39.990028 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:39.990009 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whp6d\" (UniqueName: \"kubernetes.io/projected/02f43877-de12-40bb-b526-0bb2565a7943-kube-api-access-whp6d\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:40.011568 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.011543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:40.111773 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.111740 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:40.310451 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.310424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:40.408400 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.408370 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:40.480731 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.480701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:40.480880 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.480743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:40.480880 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:40.480836 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:40.480880 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:40.480870 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:40.481040 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:40.480911 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:41.480892509 +0000 UTC m=+40.925087194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : configmap "kube-rbac-proxy" not found Jun 15 03:18:40.481040 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:40.480933 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:41.480920787 +0000 UTC m=+40.925115476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:40.509283 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:40.509251 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:41.101957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.101927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-757bh_6afea764-6a01-4e6c-a431-4f39675daa82/dns-node-resolver/0.log" Jun 15 03:18:41.305597 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.305574 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf"] Jun 15 03:18:41.320193 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.320172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf"] Jun 15 03:18:41.320549 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.320264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" Jun 15 03:18:41.322833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.322816 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 15 03:18:41.322932 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.322816 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:41.324031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.324013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jjmcn\"" Jun 15 03:18:41.343934 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.343912 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:41.466058 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.466030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:41.489155 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.489122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:41.489235 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.489179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:41.489291 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:41.489253 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:41.489342 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.489296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79j9s\" (UniqueName: \"kubernetes.io/projected/94f13a1a-3832-4b82-a8ce-57ce62fbbce1-kube-api-access-79j9s\") pod \"migrator-d4bcd4867-2pqdf\" (UID: \"94f13a1a-3832-4b82-a8ce-57ce62fbbce1\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" Jun 15 03:18:41.489342 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:41.489258 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:41.489342 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:41.489320 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:43.489300453 +0000 UTC m=+42.933495136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : configmap "kube-rbac-proxy" not found Jun 15 03:18:41.489474 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:41.489350 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:43.489340712 +0000 UTC m=+42.933535401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:41.567278 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.567252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:41.590356 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.590336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79j9s\" (UniqueName: \"kubernetes.io/projected/94f13a1a-3832-4b82-a8ce-57ce62fbbce1-kube-api-access-79j9s\") pod \"migrator-d4bcd4867-2pqdf\" (UID: \"94f13a1a-3832-4b82-a8ce-57ce62fbbce1\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" Jun 15 03:18:41.602055 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.602034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79j9s\" (UniqueName: \"kubernetes.io/projected/94f13a1a-3832-4b82-a8ce-57ce62fbbce1-kube-api-access-79j9s\") pod \"migrator-d4bcd4867-2pqdf\" (UID: \"94f13a1a-3832-4b82-a8ce-57ce62fbbce1\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" Jun 15 03:18:41.609778 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.609760 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-zbfcr"] Jun 15 03:18:41.623512 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.623492 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-zbfcr"] Jun 15 03:18:41.623605 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.623593 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.626932 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.626916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 15 03:18:41.627084 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.627071 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 15 03:18:41.627400 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.627379 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 15 03:18:41.627467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.627379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m9jbz\"" Jun 15 03:18:41.627622 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.627607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 15 03:18:41.628681 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.628667 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" Jun 15 03:18:41.716563 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.716506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:41.758377 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.758351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf"] Jun 15 03:18:41.762588 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:41.762564 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f13a1a_3832_4b82_a8ce_57ce62fbbce1.slice/crio-4698e50515cd98b512dd841fa8a40b39d661ad7bc904cba8d9bc64d51cea8c07 WatchSource:0}: Error finding container 4698e50515cd98b512dd841fa8a40b39d661ad7bc904cba8d9bc64d51cea8c07: Status 404 returned error can't find the container with id 4698e50515cd98b512dd841fa8a40b39d661ad7bc904cba8d9bc64d51cea8c07 Jun 15 03:18:41.792097 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.792075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f6b595b-bc89-4ce5-908c-8ff936b325ea-signing-cabundle\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.792190 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.792121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f6b595b-bc89-4ce5-908c-8ff936b325ea-signing-key\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.792190 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.792140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxhx\" (UniqueName: \"kubernetes.io/projected/6f6b595b-bc89-4ce5-908c-8ff936b325ea-kube-api-access-2bxhx\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.818276 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.818252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:41.892731 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.892710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f6b595b-bc89-4ce5-908c-8ff936b325ea-signing-cabundle\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.892825 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.892753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f6b595b-bc89-4ce5-908c-8ff936b325ea-signing-key\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.892825 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.892768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxhx\" (UniqueName: \"kubernetes.io/projected/6f6b595b-bc89-4ce5-908c-8ff936b325ea-kube-api-access-2bxhx\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.893409 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.893392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f6b595b-bc89-4ce5-908c-8ff936b325ea-signing-cabundle\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.894956 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.894936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f6b595b-bc89-4ce5-908c-8ff936b325ea-signing-key\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.901191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.901170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxhx\" (UniqueName: \"kubernetes.io/projected/6f6b595b-bc89-4ce5-908c-8ff936b325ea-kube-api-access-2bxhx\") pod \"service-ca-7b994bc59-zbfcr\" (UID: \"6f6b595b-bc89-4ce5-908c-8ff936b325ea\") " pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:41.901636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.901620 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-77tnc_6dbaa831-e640-4995-aa01-71d1286ee59f/node-ca/0.log" Jun 15 03:18:41.932884 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:41.932862 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" Jun 15 03:18:42.062936 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:42.062900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-zbfcr"] Jun 15 03:18:42.067251 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:42.067217 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6b595b_bc89_4ce5_908c_8ff936b325ea.slice/crio-c58cd86b340ec0610faac293c85aeb9499a1a3319c37ba28a561eb392e68a122 WatchSource:0}: Error finding container c58cd86b340ec0610faac293c85aeb9499a1a3319c37ba28a561eb392e68a122: Status 404 returned error can't find the container with id c58cd86b340ec0610faac293c85aeb9499a1a3319c37ba28a561eb392e68a122 Jun 15 03:18:42.225413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:42.225384 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" event={"ID":"6f6b595b-bc89-4ce5-908c-8ff936b325ea","Type":"ContainerStarted","Data":"c58cd86b340ec0610faac293c85aeb9499a1a3319c37ba28a561eb392e68a122"} Jun 15 03:18:42.226332 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:42.226311 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" event={"ID":"94f13a1a-3832-4b82-a8ce-57ce62fbbce1","Type":"ContainerStarted","Data":"4698e50515cd98b512dd841fa8a40b39d661ad7bc904cba8d9bc64d51cea8c07"} Jun 15 03:18:42.502036 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:42.502004 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bmdl_e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea/serve-healthcheck-canary/0.log" Jun 15 03:18:42.698131 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:42.698101 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:43.306716 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:43.306683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:43.306870 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:43.306775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:43.306870 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.306827 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:43.306941 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.306885 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:43.306941 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.306895 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls podName:65f73157-5b8b-48c5-bbeb-2ac9302282eb nodeName:}" failed. No retries permitted until 2026-06-15 03:18:51.306876757 +0000 UTC m=+50.751071454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls") pod "dns-default-gtks7" (UID: "65f73157-5b8b-48c5-bbeb-2ac9302282eb") : secret "dns-default-metrics-tls" not found Jun 15 03:18:43.306941 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.306897 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9479b4975-fhkbh: secret "image-registry-tls" not found Jun 15 03:18:43.306941 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.306933 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls podName:e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:51.306923537 +0000 UTC m=+50.751118224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls") pod "image-registry-9479b4975-fhkbh" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b") : secret "image-registry-tls" not found Jun 15 03:18:43.508409 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:43.508372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:43.508786 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:43.508432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:43.508786 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.508510 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:43.508786 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.508582 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:47.508563826 +0000 UTC m=+46.952758515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : configmap "kube-rbac-proxy" not found Jun 15 03:18:43.508786 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.508611 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:43.508786 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:43.508678 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:47.508660138 +0000 UTC m=+46.952854829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:44.231848 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:44.231777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" event={"ID":"94f13a1a-3832-4b82-a8ce-57ce62fbbce1","Type":"ContainerStarted","Data":"2ca5e888d26c2ff65724f6c51060a6ec828f87f400dff657b734e7fb341ce056"} Jun 15 03:18:44.231967 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:44.231870 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" event={"ID":"94f13a1a-3832-4b82-a8ce-57ce62fbbce1","Type":"ContainerStarted","Data":"1eddd48e76a70f5fc0ddced9f7cbc2652aa94097a365870a3f49eedfcd848461"} Jun 15 03:18:44.248651 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:44.248607 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2pqdf" podStartSLOduration=1.048992194 podStartE2EDuration="3.248589577s" totalImagesPullingTime="2.199597383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:44.248123408 +0000 UTC m=+43.692318115" watchObservedRunningTime="2026-06-15 03:18:44.248589577 +0000 UTC m=+43.692784283" Jun 15 03:18:44.606349 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:44.606282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:45.235820 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:45.235786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" event={"ID":"6f6b595b-bc89-4ce5-908c-8ff936b325ea","Type":"ContainerStarted","Data":"ed6efcae56cdd64924d996f88158d9bd767d5a471275f0610197a0f4e31cb394"} Jun 15 03:18:45.251752 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:45.251703 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-zbfcr" podStartSLOduration=1.99381853 podStartE2EDuration="4.251687676s" totalImagesPullingTime="2.257869146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:45.251160816 +0000 UTC m=+44.695355514" watchObservedRunningTime="2026-06-15 03:18:45.251687676 +0000 UTC m=+44.695882383" Jun 15 03:18:45.803636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:45.803601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:45.904940 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:45.904907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:46.013053 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:46.013023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:46.115729 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:46.115664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:46.193795 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:46.193769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:46.500407 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:46.500375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:46.893358 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:46.893332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:47.542206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:47.542177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:47.542373 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:47.542225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:47.542417 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:47.542391 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:47.542469 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:18:47.542458 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls podName:02f43877-de12-40bb-b526-0bb2565a7943 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:55.542440319 +0000 UTC m=+54.986635017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pf8xd" (UID: "02f43877-de12-40bb-b526-0bb2565a7943") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:47.542833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:47.542815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02f43877-de12-40bb-b526-0bb2565a7943-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:48.086804 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:48.086771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:48.294251 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:48.294223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:48.486539 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:48.486510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:48.684205 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:48.684177 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:48.893597 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:48.893578 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:48.951913 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:48.951893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:49.481027 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:49.481000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:49.592237 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:49.592214 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:49.885737 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:49.885703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:50.287636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:50.287569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:50.484999 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:50.484975 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:50.534197 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:50.534175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:50.690769 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:50.690738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:51.085821 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.085744 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:51.187089 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.187059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:51.286937 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.286917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:51.373688 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.373637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:51.373774 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.373696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:51.375887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.375852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"image-registry-9479b4975-fhkbh\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:51.375887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.375871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65f73157-5b8b-48c5-bbeb-2ac9302282eb-metrics-tls\") pod \"dns-default-gtks7\" (UID: \"65f73157-5b8b-48c5-bbeb-2ac9302282eb\") " pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:51.403852 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.403833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:51.442963 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.442941 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:51.568623 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.568589 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gtks7"] Jun 15 03:18:51.571877 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:51.571853 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f73157_5b8b_48c5_bbeb_2ac9302282eb.slice/crio-471d73d638bba18769306e25ac5eca89b381e8f8b4a062c7382c66192892931f WatchSource:0}: Error finding container 471d73d638bba18769306e25ac5eca89b381e8f8b4a062c7382c66192892931f: Status 404 returned error can't find the container with id 471d73d638bba18769306e25ac5eca89b381e8f8b4a062c7382c66192892931f Jun 15 03:18:51.587947 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.587925 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9479b4975-fhkbh"] Jun 15 03:18:51.590463 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:51.590437 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode167a4b7_89c4_4abe_bc0f_0c5c3e5c9f9b.slice/crio-e485dbaa06a31d91ce5c2a6c7f5353fb2fd4722335385a7da67efa6d9c4d7db5 WatchSource:0}: Error finding container e485dbaa06a31d91ce5c2a6c7f5353fb2fd4722335385a7da67efa6d9c4d7db5: Status 404 returned error can't find the container with id e485dbaa06a31d91ce5c2a6c7f5353fb2fd4722335385a7da67efa6d9c4d7db5 Jun 15 03:18:51.683347 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:51.683322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:52.115978 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.115946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:52.254183 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.254131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" event={"ID":"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b","Type":"ContainerStarted","Data":"4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446"} Jun 15 03:18:52.254366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.254304 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:18:52.254366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.254352 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" event={"ID":"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b","Type":"ContainerStarted","Data":"e485dbaa06a31d91ce5c2a6c7f5353fb2fd4722335385a7da67efa6d9c4d7db5"} Jun 15 03:18:52.255273 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.255251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtks7" event={"ID":"65f73157-5b8b-48c5-bbeb-2ac9302282eb","Type":"ContainerStarted","Data":"471d73d638bba18769306e25ac5eca89b381e8f8b4a062c7382c66192892931f"} Jun 15 03:18:52.277749 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.277710 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" podStartSLOduration=41.277696503 podStartE2EDuration="41.277696503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:52.276169234 +0000 UTC m=+51.720363959" watchObservedRunningTime="2026-06-15 03:18:52.277696503 +0000 UTC m=+51.721891208" Jun 15 03:18:52.292075 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.292050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:52.484015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.483989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:52.685048 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:52.685015 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:53.084328 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:53.084292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:53.683955 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:53.683872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:54.283386 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:54.283322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:54.481444 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:54.481417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:54.886453 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:54.886430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:55.082742 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.082709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:55.265730 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.265655 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtks7" event={"ID":"65f73157-5b8b-48c5-bbeb-2ac9302282eb","Type":"ContainerStarted","Data":"73bb99f9c32898aa16870daaed9105a3ff3c3f6c5489e03863e8fc3ab1229b36"} Jun 15 03:18:55.265730 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.265712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtks7" event={"ID":"65f73157-5b8b-48c5-bbeb-2ac9302282eb","Type":"ContainerStarted","Data":"ffa9c8c8e1b454b0693168b1b0da98b9f18720d178e0b10577da6ab0e060629a"} Jun 15 03:18:55.265899 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.265772 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gtks7" Jun 15 03:18:55.284174 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.284113 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gtks7" podStartSLOduration=17.639652759 podStartE2EDuration="20.284100421s" totalImagesPullingTime="2.644447662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:55.282133742 +0000 UTC m=+54.726328448" watchObservedRunningTime="2026-06-15 03:18:55.284100421 +0000 UTC m=+54.728295141" Jun 15 03:18:55.605970 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.605892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:55.608167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.608125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02f43877-de12-40bb-b526-0bb2565a7943-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf8xd\" (UID: \"02f43877-de12-40bb-b526-0bb2565a7943\") " pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:55.651163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.651131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pf8xd" Jun 15 03:18:55.691872 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.691843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:55.771722 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:55.771699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pf8xd"] Jun 15 03:18:55.774137 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:18:55.774108 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f43877_de12_40bb_b526_0bb2565a7943.slice/crio-b4ca196d4d3d5ad8f0e761e4e3315ef316b8faf31532e99c1a9e1e698c3d8c85 WatchSource:0}: Error finding container b4ca196d4d3d5ad8f0e761e4e3315ef316b8faf31532e99c1a9e1e698c3d8c85: Status 404 returned error can't find the container with id b4ca196d4d3d5ad8f0e761e4e3315ef316b8faf31532e99c1a9e1e698c3d8c85 Jun 15 03:18:56.089550 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:56.089522 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:56.269463 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:56.269431 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf8xd" event={"ID":"02f43877-de12-40bb-b526-0bb2565a7943","Type":"ContainerStarted","Data":"b4ca196d4d3d5ad8f0e761e4e3315ef316b8faf31532e99c1a9e1e698c3d8c85"} Jun 15 03:18:56.280982 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:56.280952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:56.483920 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:56.483850 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:58.038493 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:58.038455 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:58.134726 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:58.134685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:18:59.280481 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:18:59.280453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf8xd" event={"ID":"02f43877-de12-40bb-b526-0bb2565a7943","Type":"ContainerStarted","Data":"6ba521446384e095b4852bf96c5bdbfb9ec30cc702c6b3e91fe6686bfa98348c"} Jun 15 03:19:00.286033 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:00.286000 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf8xd" event={"ID":"02f43877-de12-40bb-b526-0bb2565a7943","Type":"ContainerStarted","Data":"f95850b36880f7bc855f315a2c36b481ed974f275afb8b79dcc712a8aa527434"} Jun 15 03:19:01.197790 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:01.197760 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lnxn5" Jun 15 03:19:01.790678 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:01.790628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:01.891908 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:01.891867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:02.077467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.077369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:02.294532 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.294506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf8xd" event={"ID":"02f43877-de12-40bb-b526-0bb2565a7943","Type":"ContainerStarted","Data":"46afff07b8605515cc36b7ec1614e6bc0423c73a6a6966b81f54fc9f13be1c32"} Jun 15 03:19:02.311364 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.311319 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pf8xd" podStartSLOduration=17.541407764 podStartE2EDuration="23.311306209s" totalImagesPullingTime="5.769898445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:02.310837794 +0000 UTC m=+61.755032523" watchObservedRunningTime="2026-06-15 03:19:02.311306209 +0000 UTC m=+61.755500916" Jun 15 03:19:02.453887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.453848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:02.506896 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.506873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:02.653519 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.653494 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:02.707055 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.706997 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:02.866908 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:02.866883 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.117635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.117557 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt"] Jun 15 03:19:03.120481 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.120461 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7"] Jun 15 03:19:03.120610 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.120560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.123308 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.123289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.123441 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.123419 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 03:19:03.123596 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.123424 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 03:19:03.123681 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.123548 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 15 03:19:03.123681 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.123585 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 03:19:03.125986 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.125966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h7l9p\"" Jun 15 03:19:03.126064 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.126036 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 15 03:19:03.130128 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.130109 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9479b4975-fhkbh"] Jun 15 03:19:03.134896 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.134875 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt"] Jun 15 03:19:03.140384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.140362 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7"] Jun 15 03:19:03.148884 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.148861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.161096 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.161069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpp4\" (UniqueName: \"kubernetes.io/projected/d86c366c-e84f-4fa7-af65-7d6600b43714-kube-api-access-6tpp4\") pod \"managed-serviceaccount-addon-agent-767f48d7fd-mfwq7\" (UID: \"d86c366c-e84f-4fa7-af65-7d6600b43714\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.161198 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.161123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-tmp\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.161243 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.161211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d86c366c-e84f-4fa7-af65-7d6600b43714-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-767f48d7fd-mfwq7\" (UID: \"d86c366c-e84f-4fa7-af65-7d6600b43714\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.161277 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.161245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwnjz\" (UniqueName: \"kubernetes.io/projected/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-kube-api-access-zwnjz\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.161277 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.161270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-klusterlet-config\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.212572 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.212552 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-7dm2x"] Jun 15 03:19:03.215492 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.215476 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:03.217359 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.217343 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54f6896464-8pgmc"] Jun 15 03:19:03.220029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.220014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.220788 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.220772 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 03:19:03.220879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.220772 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 03:19:03.220951 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.220879 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vc267\"" Jun 15 03:19:03.238767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.238747 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-7dm2x"] Jun 15 03:19:03.239510 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.239489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f6896464-8pgmc"] Jun 15 03:19:03.261998 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.261976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwnjz\" (UniqueName: \"kubernetes.io/projected/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-kube-api-access-zwnjz\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.262083 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-installation-pull-secrets\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262083 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-trusted-ca\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262083 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-klusterlet-config\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.262083 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn92p\" (UniqueName: \"kubernetes.io/projected/de7f22e9-5d98-41d7-97ec-3285990ea747-kube-api-access-wn92p\") pod \"downloads-694c955b9-7dm2x\" (UID: \"de7f22e9-5d98-41d7-97ec-3285990ea747\") " pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:03.262250 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-image-registry-private-configuration\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262250 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277zx\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-kube-api-access-277zx\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262250 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpp4\" (UniqueName: \"kubernetes.io/projected/d86c366c-e84f-4fa7-af65-7d6600b43714-kube-api-access-6tpp4\") pod \"managed-serviceaccount-addon-agent-767f48d7fd-mfwq7\" (UID: \"d86c366c-e84f-4fa7-af65-7d6600b43714\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.262250 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-registry-tls\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262250 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-bound-sa-token\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262430 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-ca-trust-extracted\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262430 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-tmp\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.262430 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d86c366c-e84f-4fa7-af65-7d6600b43714-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-767f48d7fd-mfwq7\" (UID: \"d86c366c-e84f-4fa7-af65-7d6600b43714\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.262430 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-registry-certificates\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.262701 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.262682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-tmp\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.264624 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.264596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-klusterlet-config\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.265038 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.265016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d86c366c-e84f-4fa7-af65-7d6600b43714-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-767f48d7fd-mfwq7\" (UID: \"d86c366c-e84f-4fa7-af65-7d6600b43714\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.265635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.265618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.272516 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.272493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpp4\" (UniqueName: \"kubernetes.io/projected/d86c366c-e84f-4fa7-af65-7d6600b43714-kube-api-access-6tpp4\") pod \"managed-serviceaccount-addon-agent-767f48d7fd-mfwq7\" (UID: \"d86c366c-e84f-4fa7-af65-7d6600b43714\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.272650 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.272636 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwnjz\" (UniqueName: \"kubernetes.io/projected/f4ceee0e-6456-4b19-a38e-b4531cc4f3a8-kube-api-access-zwnjz\") pod \"klusterlet-addon-workmgr-588f6576cc-bxqqt\" (UID: \"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.363617 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-registry-certificates\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.363733 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-installation-pull-secrets\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.363733 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-trusted-ca\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.363840 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn92p\" (UniqueName: \"kubernetes.io/projected/de7f22e9-5d98-41d7-97ec-3285990ea747-kube-api-access-wn92p\") pod \"downloads-694c955b9-7dm2x\" (UID: \"de7f22e9-5d98-41d7-97ec-3285990ea747\") " pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:03.363840 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-image-registry-private-configuration\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.363840 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277zx\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-kube-api-access-277zx\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.364040 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-registry-tls\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.364040 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.363874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-bound-sa-token\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.364134 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.364118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-ca-trust-extracted\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.364703 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.364500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-registry-certificates\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.364703 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.364528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-ca-trust-extracted\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.364846 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.364821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-trusted-ca\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.365369 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.365330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.366512 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.366490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-image-registry-private-configuration\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.366617 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.366536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-installation-pull-secrets\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.366747 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.366727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-registry-tls\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.387352 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.387332 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-bound-sa-token\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.387423 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.387384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-277zx\" (UniqueName: \"kubernetes.io/projected/24b12bef-ddaf-4429-bb38-e1c1ddd3a008-kube-api-access-277zx\") pod \"image-registry-54f6896464-8pgmc\" (UID: \"24b12bef-ddaf-4429-bb38-e1c1ddd3a008\") " pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.390588 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.390572 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn92p\" (UniqueName: \"kubernetes.io/projected/de7f22e9-5d98-41d7-97ec-3285990ea747-kube-api-access-wn92p\") pod \"downloads-694c955b9-7dm2x\" (UID: \"de7f22e9-5d98-41d7-97ec-3285990ea747\") " pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:03.430936 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.430915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:03.445221 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.445195 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" Jun 15 03:19:03.468029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.468004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.526910 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.526662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:03.532256 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.532125 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:03.556385 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.556208 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.587630 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.587063 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt"] Jun 15 03:19:03.591391 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:03.591344 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ceee0e_6456_4b19_a38e_b4531cc4f3a8.slice/crio-22447de264c54b210fba3593b8d2f88931dc4ffd72e6e112519ce624f7abe57f WatchSource:0}: Error finding container 22447de264c54b210fba3593b8d2f88931dc4ffd72e6e112519ce624f7abe57f: Status 404 returned error can't find the container with id 22447de264c54b210fba3593b8d2f88931dc4ffd72e6e112519ce624f7abe57f Jun 15 03:19:03.605745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.604550 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7"] Jun 15 03:19:03.682512 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.682475 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-7dm2x"] Jun 15 03:19:03.686400 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:03.686362 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7f22e9_5d98_41d7_97ec_3285990ea747.slice/crio-dd75cd832a4a14b0d36ec8989712c5bd37683e1e8182985f67e3374d302c968a WatchSource:0}: Error finding container dd75cd832a4a14b0d36ec8989712c5bd37683e1e8182985f67e3374d302c968a: Status 404 returned error can't find the container with id dd75cd832a4a14b0d36ec8989712c5bd37683e1e8182985f67e3374d302c968a Jun 15 03:19:03.686400 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.686359 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.702036 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.702012 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f6896464-8pgmc"] Jun 15 03:19:03.706241 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:03.706218 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b12bef_ddaf_4429_bb38_e1c1ddd3a008.slice/crio-5f63f3820bdd703f3602077110712b92b1353f341c9f13ac7d160c339546f90a WatchSource:0}: Error finding container 5f63f3820bdd703f3602077110712b92b1353f341c9f13ac7d160c339546f90a: Status 404 returned error can't find the container with id 5f63f3820bdd703f3602077110712b92b1353f341c9f13ac7d160c339546f90a Jun 15 03:19:03.780286 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.780263 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:03.850976 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:03.850943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:04.053352 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.053280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:04.305458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.305327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-7dm2x" event={"ID":"de7f22e9-5d98-41d7-97ec-3285990ea747","Type":"ContainerStarted","Data":"dd75cd832a4a14b0d36ec8989712c5bd37683e1e8182985f67e3374d302c968a"} Jun 15 03:19:04.307243 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.307177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" event={"ID":"d86c366c-e84f-4fa7-af65-7d6600b43714","Type":"ContainerStarted","Data":"95a299c12980acaff661d6239d249a6ab09b6e5dbea90a092b05634e733c3be8"} Jun 15 03:19:04.310261 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.310138 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" event={"ID":"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8","Type":"ContainerStarted","Data":"22447de264c54b210fba3593b8d2f88931dc4ffd72e6e112519ce624f7abe57f"} Jun 15 03:19:04.313718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.312951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" event={"ID":"24b12bef-ddaf-4429-bb38-e1c1ddd3a008","Type":"ContainerStarted","Data":"96ba261a5365fc530b8a243427f53cf2d026548b99005665c5d3bea4f08f4887"} Jun 15 03:19:04.313718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.312993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" event={"ID":"24b12bef-ddaf-4429-bb38-e1c1ddd3a008","Type":"ContainerStarted","Data":"5f63f3820bdd703f3602077110712b92b1353f341c9f13ac7d160c339546f90a"} Jun 15 03:19:04.313718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.313675 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:04.336386 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.336183 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" podStartSLOduration=1.336165379 podStartE2EDuration="1.336165379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:04.333835643 +0000 UTC m=+63.778030360" watchObservedRunningTime="2026-06-15 03:19:04.336165379 +0000 UTC m=+63.780360079" Jun 15 03:19:04.351814 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.351788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:04.451825 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.451706 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:04.747189 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.747143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:04.801964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:04.801932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:05.273573 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:05.272898 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gtks7" Jun 15 03:19:05.278312 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:05.278282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:05.548044 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:05.547962 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:05.609641 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:05.609577 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:05.949389 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:05.949349 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:05.999799 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:05.999709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:06.794990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.794810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:19:06.794990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.794868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:19:06.797648 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.797592 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 03:19:06.798734 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.798715 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 03:19:06.811055 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.811003 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb40c396-e41d-4cf3-96a4-f8444b7ab6c2-metrics-certs\") pod \"network-metrics-daemon-s79jd\" (UID: \"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2\") " pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:19:06.812717 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.812672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12877bea-aec9-4962-b0ea-53657adcb9e1-original-pull-secret\") pod \"global-pull-secret-syncer-xfmcz\" (UID: \"12877bea-aec9-4962-b0ea-53657adcb9e1\") " pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:19:06.895831 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.895799 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:19:06.898329 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.898296 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 03:19:06.909485 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.909459 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 03:19:06.920369 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.920316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmt9l\" (UniqueName: \"kubernetes.io/projected/cb043e1e-8d84-4e97-9857-07d22f359c98-kube-api-access-bmt9l\") pod \"network-check-target-v4hp7\" (UID: \"cb043e1e-8d84-4e97-9857-07d22f359c98\") " pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:19:06.932037 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:06.932007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:07.034065 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.034031 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:07.056832 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.056721 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9frqx\"" Jun 15 03:19:07.064750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.064722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:19:07.064871 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.064804 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbt26\"" Jun 15 03:19:07.068241 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.068221 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmcz" Jun 15 03:19:07.072361 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.072336 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s79jd" Jun 15 03:19:07.108962 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.108940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:07.112448 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.112421 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47"] Jun 15 03:19:07.128273 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.128231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47"] Jun 15 03:19:07.128379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.128339 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:07.133755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.133567 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 15 03:19:07.133755 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.133664 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lhkn2\"" Jun 15 03:19:07.168139 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.168114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:07.197857 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.197831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/08ad4733-423b-4477-bfca-3adc77de85c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-t8c47\" (UID: \"08ad4733-423b-4477-bfca-3adc77de85c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:07.299114 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.299083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/08ad4733-423b-4477-bfca-3adc77de85c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-t8c47\" (UID: \"08ad4733-423b-4477-bfca-3adc77de85c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:07.301733 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.301710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/08ad4733-423b-4477-bfca-3adc77de85c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-t8c47\" (UID: \"08ad4733-423b-4477-bfca-3adc77de85c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:07.442462 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.442401 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:07.609403 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.609366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:07.708938 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:07.708868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:08.150247 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:08.150210 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:08.548588 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:08.548509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:08.603643 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:08.603605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:09.313035 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.310553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfmcz"] Jun 15 03:19:09.341209 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.340780 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" event={"ID":"f4ceee0e-6456-4b19-a38e-b4531cc4f3a8","Type":"ContainerStarted","Data":"9b8f9c5f27e945764df523031fa825b3333f3d3d413506ea352ab26af4250409"} Jun 15 03:19:09.341209 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.341100 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:09.342528 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.342474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" Jun 15 03:19:09.343374 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.343348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" event={"ID":"d86c366c-e84f-4fa7-af65-7d6600b43714","Type":"ContainerStarted","Data":"b98f3fec2770d166c0eb939e777cfa9afc25abedbcd1879ccd99e1954c33e9c5"} Jun 15 03:19:09.345421 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.345395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfmcz" event={"ID":"12877bea-aec9-4962-b0ea-53657adcb9e1","Type":"ContainerStarted","Data":"74582a4e33a9ed57507367fbc17f3244af8bf0b091b290cfb686a8f064394b3a"} Jun 15 03:19:09.360704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.360661 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588f6576cc-bxqqt" podStartSLOduration=0.74750985 podStartE2EDuration="6.360649222s" totalImagesPullingTime="5.613139372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:09.359755663 +0000 UTC m=+68.803950362" watchObservedRunningTime="2026-06-15 03:19:09.360649222 +0000 UTC m=+68.804843958" Jun 15 03:19:09.367350 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.366673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47"] Jun 15 03:19:09.368851 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:09.368829 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ad4733_423b_4477_bfca_3adc77de85c6.slice/crio-f87a9702768852b40c208560a2eeb84a2e8b28c9920b3c9cee0d0914feb7eb28 WatchSource:0}: Error finding container f87a9702768852b40c208560a2eeb84a2e8b28c9920b3c9cee0d0914feb7eb28: Status 404 returned error can't find the container with id f87a9702768852b40c208560a2eeb84a2e8b28c9920b3c9cee0d0914feb7eb28 Jun 15 03:19:09.390607 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.390564 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-767f48d7fd-mfwq7" podStartSLOduration=0.868912144 podStartE2EDuration="6.390550636s" totalImagesPullingTime="5.521638492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:09.389652152 +0000 UTC m=+68.833846857" watchObservedRunningTime="2026-06-15 03:19:09.390550636 +0000 UTC m=+68.834745342" Jun 15 03:19:09.536256 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.536231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v4hp7"] Jun 15 03:19:09.538919 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.538894 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s79jd"] Jun 15 03:19:09.539123 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:09.539100 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb043e1e_8d84_4e97_9857_07d22f359c98.slice/crio-db6c42bfe2cd1d2d23cdd689c56de9c480d4e5c23e636103644791661b58cdb2 WatchSource:0}: Error finding container db6c42bfe2cd1d2d23cdd689c56de9c480d4e5c23e636103644791661b58cdb2: Status 404 returned error can't find the container with id db6c42bfe2cd1d2d23cdd689c56de9c480d4e5c23e636103644791661b58cdb2 Jun 15 03:19:09.542186 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:09.542166 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb40c396_e41d_4cf3_96a4_f8444b7ab6c2.slice/crio-527ab10ea9b230e5d6d5221194c85ffc21e947e8ec59001fd6eaffcb97328ae2 WatchSource:0}: Error finding container 527ab10ea9b230e5d6d5221194c85ffc21e947e8ec59001fd6eaffcb97328ae2: Status 404 returned error can't find the container with id 527ab10ea9b230e5d6d5221194c85ffc21e947e8ec59001fd6eaffcb97328ae2 Jun 15 03:19:09.999533 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:09.999460 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:10.051589 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:10.051520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:10.353534 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:10.353451 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v4hp7" event={"ID":"cb043e1e-8d84-4e97-9857-07d22f359c98","Type":"ContainerStarted","Data":"db6c42bfe2cd1d2d23cdd689c56de9c480d4e5c23e636103644791661b58cdb2"} Jun 15 03:19:10.356236 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:10.356207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s79jd" event={"ID":"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2","Type":"ContainerStarted","Data":"527ab10ea9b230e5d6d5221194c85ffc21e947e8ec59001fd6eaffcb97328ae2"} Jun 15 03:19:10.358626 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:10.358596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" event={"ID":"08ad4733-423b-4477-bfca-3adc77de85c6","Type":"ContainerStarted","Data":"f87a9702768852b40c208560a2eeb84a2e8b28c9920b3c9cee0d0914feb7eb28"} Jun 15 03:19:11.367550 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.367058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s79jd" event={"ID":"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2","Type":"ContainerStarted","Data":"d8e722a414f1a398ee450fcfb20326dbe9d777beaf6dca40862ac261513edc16"} Jun 15 03:19:11.367550 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.367124 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s79jd" event={"ID":"bb40c396-e41d-4cf3-96a4-f8444b7ab6c2","Type":"ContainerStarted","Data":"32d2b4f150051234510595d9f736fe8182ccf1a4e2bb16967e7c670376d80cb1"} Jun 15 03:19:11.371873 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.371503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" event={"ID":"08ad4733-423b-4477-bfca-3adc77de85c6","Type":"ContainerStarted","Data":"84d598ad279ea9313da6b48cbd7c519dbff727971016487040214ddc5d31bb78"} Jun 15 03:19:11.372076 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.372032 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:11.378775 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.378731 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" Jun 15 03:19:11.386718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.385833 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s79jd" podStartSLOduration=68.964349561 podStartE2EDuration="1m10.385817407s" totalImagesPullingTime="1.421467846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:11.384700365 +0000 UTC m=+70.828895074" watchObservedRunningTime="2026-06-15 03:19:11.385817407 +0000 UTC m=+70.830012117" Jun 15 03:19:11.501758 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.501634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:11.561827 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:11.561794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:12.138860 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.138748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:12.174135 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.174077 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-t8c47" podStartSLOduration=3.583080927 podStartE2EDuration="5.174052806s" totalImagesPullingTime="1.590971879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:11.400502452 +0000 UTC m=+70.844697160" watchObservedRunningTime="2026-06-15 03:19:12.174052806 +0000 UTC m=+71.618247553" Jun 15 03:19:12.175059 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.175034 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf"] Jun 15 03:19:12.180032 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.179978 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.183424 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.183073 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5th58\"" Jun 15 03:19:12.193031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.188683 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 03:19:12.193031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.188939 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 03:19:12.193031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.192764 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf"] Jun 15 03:19:12.193031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.192923 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 03:19:12.197068 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.193464 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 03:19:12.197068 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.193892 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 03:19:12.227524 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.227459 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:12.239217 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.239189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.239334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.239233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24180e8d-2092-420e-907d-fc47b8b3a1ab-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.239334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.239269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.239334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.239324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnntz\" (UniqueName: \"kubernetes.io/projected/24180e8d-2092-420e-907d-fc47b8b3a1ab-kube-api-access-xnntz\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.340312 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.339792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.340312 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.339838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24180e8d-2092-420e-907d-fc47b8b3a1ab-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.340312 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.339870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.340312 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.339902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnntz\" (UniqueName: \"kubernetes.io/projected/24180e8d-2092-420e-907d-fc47b8b3a1ab-kube-api-access-xnntz\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.340312 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:12.340002 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 03:19:12.340312 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:12.340081 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls podName:24180e8d-2092-420e-907d-fc47b8b3a1ab nodeName:}" failed. No retries permitted until 2026-06-15 03:19:12.840058995 +0000 UTC m=+72.284253702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-h6gpf" (UID: "24180e8d-2092-420e-907d-fc47b8b3a1ab") : secret "prometheus-operator-tls" not found Jun 15 03:19:12.340749 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.340669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24180e8d-2092-420e-907d-fc47b8b3a1ab-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.343864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.343806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.348978 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.348944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnntz\" (UniqueName: \"kubernetes.io/projected/24180e8d-2092-420e-907d-fc47b8b3a1ab-kube-api-access-xnntz\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.843978 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:12.843938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:12.844467 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:12.844053 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 03:19:12.844467 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:12.844130 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls podName:24180e8d-2092-420e-907d-fc47b8b3a1ab nodeName:}" failed. No retries permitted until 2026-06-15 03:19:13.844109198 +0000 UTC m=+73.288303897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-h6gpf" (UID: "24180e8d-2092-420e-907d-fc47b8b3a1ab") : secret "prometheus-operator-tls" not found Jun 15 03:19:13.021825 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:13.021780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:13.120997 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:13.120924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:13.138931 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:13.138353 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:19:13.226305 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:13.226259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:13.852374 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:13.852341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:13.855451 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:13.855421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/24180e8d-2092-420e-907d-fc47b8b3a1ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-h6gpf\" (UID: \"24180e8d-2092-420e-907d-fc47b8b3a1ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:14.006781 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:14.006744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" Jun 15 03:19:14.391785 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:14.391747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:14.494467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:14.494439 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:15.157554 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.157516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf"] Jun 15 03:19:15.161010 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:15.160953 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24180e8d_2092_420e_907d_fc47b8b3a1ab.slice/crio-fc8f6b2f3cf239cd350d95f683faadad2bd0a79ef820fafa19f73af5ce2466fa WatchSource:0}: Error finding container fc8f6b2f3cf239cd350d95f683faadad2bd0a79ef820fafa19f73af5ce2466fa: Status 404 returned error can't find the container with id fc8f6b2f3cf239cd350d95f683faadad2bd0a79ef820fafa19f73af5ce2466fa Jun 15 03:19:15.393910 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.393573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v4hp7" event={"ID":"cb043e1e-8d84-4e97-9857-07d22f359c98","Type":"ContainerStarted","Data":"586093e9196e8138ed6aa2f8973fbc2ce49906060544adf3c906617e57da7961"} Jun 15 03:19:15.393910 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.393741 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:19:15.395176 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.395132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" event={"ID":"24180e8d-2092-420e-907d-fc47b8b3a1ab","Type":"ContainerStarted","Data":"fc8f6b2f3cf239cd350d95f683faadad2bd0a79ef820fafa19f73af5ce2466fa"} Jun 15 03:19:15.396743 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.396711 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfmcz" event={"ID":"12877bea-aec9-4962-b0ea-53657adcb9e1","Type":"ContainerStarted","Data":"c10d17f22837a1f89b11c7339f0f0bf95444179f8100e4d3d702957e899604f4"} Jun 15 03:19:15.408671 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.408626 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v4hp7" podStartSLOduration=68.930693728 podStartE2EDuration="1m14.408608272s" totalImagesPullingTime="5.477914544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:15.407857562 +0000 UTC m=+74.852052268" watchObservedRunningTime="2026-06-15 03:19:15.408608272 +0000 UTC m=+74.852802980" Jun 15 03:19:15.424762 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:15.424716 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xfmcz" podStartSLOduration=68.714809487 podStartE2EDuration="1m14.424700452s" totalImagesPullingTime="5.709890965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:15.423658699 +0000 UTC m=+74.867853406" watchObservedRunningTime="2026-06-15 03:19:15.424700452 +0000 UTC m=+74.868895159" Jun 15 03:19:16.690242 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:16.690210 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:16.791105 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:16.791069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:16.893004 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:16.892964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:17.408460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:17.408418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" event={"ID":"24180e8d-2092-420e-907d-fc47b8b3a1ab","Type":"ContainerStarted","Data":"16393b3eef9ab8fee2fddec66eb97fc79ba01db463b1b0ed9c723af352cc66ad"} Jun 15 03:19:17.408629 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:17.408478 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" event={"ID":"24180e8d-2092-420e-907d-fc47b8b3a1ab","Type":"ContainerStarted","Data":"b48ed5a35ba5a29de19aaf65a840c0431625bef95b41983076a9c46cd8f0576c"} Jun 15 03:19:17.427658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:17.427601 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-h6gpf" podStartSLOduration=4.026092001 podStartE2EDuration="5.427582187s" totalImagesPullingTime="1.401490186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:17.425254393 +0000 UTC m=+76.869449100" watchObservedRunningTime="2026-06-15 03:19:17.427582187 +0000 UTC m=+76.871776897" Jun 15 03:19:19.072290 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.072253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:19.123491 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.123456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:19.286088 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.286053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:19.299089 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.299060 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6597f8f9bb-nlgrt"] Jun 15 03:19:19.303475 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.303450 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.306425 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.306403 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 03:19:19.306522 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.306452 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-snt88\"" Jun 15 03:19:19.306621 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.306403 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 03:19:19.306886 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.306869 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 03:19:19.307365 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.307329 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 03:19:19.307476 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.307401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 03:19:19.311906 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.311884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 03:19:19.312953 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.312934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6597f8f9bb-nlgrt"] Jun 15 03:19:19.396919 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.396888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-service-ca\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.397076 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.396941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-trusted-ca-bundle\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.397076 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.396968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-config\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.397076 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.397026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-oauth-config\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.397076 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.397061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qck\" (UniqueName: \"kubernetes.io/projected/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-kube-api-access-j6qck\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.397310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.397096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-oauth-serving-cert\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.397310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.397128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-serving-cert\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497543 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-service-ca\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497713 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-trusted-ca-bundle\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497713 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-config\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497713 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-oauth-config\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497713 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qck\" (UniqueName: \"kubernetes.io/projected/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-kube-api-access-j6qck\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497919 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-oauth-serving-cert\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.497919 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.497755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-serving-cert\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.498531 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.498503 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-trusted-ca-bundle\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.499485 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.499445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:19.499626 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.499601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-service-ca\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.500164 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.499948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-oauth-serving-cert\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.500164 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.500091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-config\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.502942 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.502643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-serving-cert\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.502942 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.502666 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-oauth-config\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.515457 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.515368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qck\" (UniqueName: \"kubernetes.io/projected/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-kube-api-access-j6qck\") pod \"console-6597f8f9bb-nlgrt\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.525005 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.524307 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9"] Jun 15 03:19:19.529264 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.529246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.535508 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.532218 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 15 03:19:19.535508 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.532237 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f56g2\"" Jun 15 03:19:19.535508 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.532229 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 15 03:19:19.544822 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.544172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9"] Jun 15 03:19:19.546139 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.546098 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg"] Jun 15 03:19:19.550322 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.550306 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-89rzh"] Jun 15 03:19:19.550460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.550441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.553826 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.553040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 03:19:19.553826 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.553336 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 03:19:19.553826 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.553467 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mgplq\"" Jun 15 03:19:19.553826 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.553528 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 03:19:19.554259 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.554243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.563477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.557860 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 03:19:19.563477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.557906 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 03:19:19.563477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.558048 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z4qgl\"" Jun 15 03:19:19.563477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.558209 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 03:19:19.563477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.562074 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg"] Jun 15 03:19:19.582946 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.582924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:19.599265 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.599242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8df3111b-f879-4a06-bf86-70bc22ef645e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.599366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.599308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.599430 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.599412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.599485 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.599445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lztn\" (UniqueName: \"kubernetes.io/projected/8df3111b-f879-4a06-bf86-70bc22ef645e-kube-api-access-7lztn\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.616229 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.616213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.700747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.700808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.700955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnqf\" (UniqueName: \"kubernetes.io/projected/e4b988a1-3763-4da1-8819-044c925d9b51-kube-api-access-8jnqf\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.700993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lztn\" (UniqueName: \"kubernetes.io/projected/8df3111b-f879-4a06-bf86-70bc22ef645e-kube-api-access-7lztn\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qltx\" (UniqueName: \"kubernetes.io/projected/c11a57d1-f57f-434d-91e5-45854465be37-kube-api-access-5qltx\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-accelerators-collector-config\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8df3111b-f879-4a06-bf86-70bc22ef645e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-sys\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c11a57d1-f57f-434d-91e5-45854465be37-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-textfile\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-root\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.701559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-wtmp\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b988a1-3763-4da1-8819-044c925d9b51-metrics-client-ca\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:19.701439 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c11a57d1-f57f-434d-91e5-45854465be37-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-tls\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:19.701514 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-tls podName:8df3111b-f879-4a06-bf86-70bc22ef645e nodeName:}" failed. No retries permitted until 2026-06-15 03:19:20.201492361 +0000 UTC m=+79.645687050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-tdmf9" (UID: "8df3111b-f879-4a06-bf86-70bc22ef645e") : secret "openshift-state-metrics-tls" not found Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.701588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.702320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.702016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8df3111b-f879-4a06-bf86-70bc22ef645e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.705062 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.705018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.710099 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.710076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lztn\" (UniqueName: \"kubernetes.io/projected/8df3111b-f879-4a06-bf86-70bc22ef645e-kube-api-access-7lztn\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:19.802396 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802520 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qltx\" (UniqueName: \"kubernetes.io/projected/c11a57d1-f57f-434d-91e5-45854465be37-kube-api-access-5qltx\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.802520 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-accelerators-collector-config\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802520 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-sys\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802643 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c11a57d1-f57f-434d-91e5-45854465be37-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.802643 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.802643 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-textfile\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802765 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-root\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802765 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-wtmp\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802765 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b988a1-3763-4da1-8819-044c925d9b51-metrics-client-ca\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802765 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c11a57d1-f57f-434d-91e5-45854465be37-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.802897 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-tls\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.802897 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.802897 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.802897 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.802872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnqf\" (UniqueName: \"kubernetes.io/projected/e4b988a1-3763-4da1-8819-044c925d9b51-kube-api-access-8jnqf\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.803586 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.803555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-root\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.803721 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.803629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-sys\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.803992 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.803968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c11a57d1-f57f-434d-91e5-45854465be37-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.804098 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:19.804079 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 03:19:19.804183 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:19.804170 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-tls podName:e4b988a1-3763-4da1-8819-044c925d9b51 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:20.304133328 +0000 UTC m=+79.748328013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-tls") pod "node-exporter-89rzh" (UID: "e4b988a1-3763-4da1-8819-044c925d9b51") : secret "node-exporter-tls" not found Jun 15 03:19:19.804322 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.804301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-accelerators-collector-config\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.804428 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:19.804411 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 15 03:19:19.804482 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:19.804459 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-tls podName:c11a57d1-f57f-434d-91e5-45854465be37 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:20.30444269 +0000 UTC m=+79.748637374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-jrzxg" (UID: "c11a57d1-f57f-434d-91e5-45854465be37") : secret "kube-state-metrics-tls" not found Jun 15 03:19:19.805032 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.804540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-textfile\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.805032 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.804675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.805032 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.803968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-wtmp\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.805032 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.804939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b988a1-3763-4da1-8819-044c925d9b51-metrics-client-ca\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.805458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.805409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c11a57d1-f57f-434d-91e5-45854465be37-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.806619 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.806598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.807822 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.807801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.813501 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.813439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qltx\" (UniqueName: \"kubernetes.io/projected/c11a57d1-f57f-434d-91e5-45854465be37-kube-api-access-5qltx\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:19.814025 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.813994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnqf\" (UniqueName: \"kubernetes.io/projected/e4b988a1-3763-4da1-8819-044c925d9b51-kube-api-access-8jnqf\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:19.889807 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.889777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:19.990120 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:19.990000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.090673 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.090637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.191540 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.191500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.206458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.206352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:20.208951 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.208923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8df3111b-f879-4a06-bf86-70bc22ef645e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-tdmf9\" (UID: \"8df3111b-f879-4a06-bf86-70bc22ef645e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:20.291430 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.291360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.307467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.307439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-tls\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:20.307581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.307483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:20.310002 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.309982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4b988a1-3763-4da1-8819-044c925d9b51-node-exporter-tls\") pod \"node-exporter-89rzh\" (UID: \"e4b988a1-3763-4da1-8819-044c925d9b51\") " pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:20.310112 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.310021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c11a57d1-f57f-434d-91e5-45854465be37-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-jrzxg\" (UID: \"c11a57d1-f57f-434d-91e5-45854465be37\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:20.390901 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.390868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.449613 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.449581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" Jun 15 03:19:20.471116 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.471088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" Jun 15 03:19:20.479086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.479050 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-89rzh" Jun 15 03:19:20.506847 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.506806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.589099 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.589010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:20.594249 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.594218 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 03:19:20.598340 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.598315 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.601128 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.601027 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 03:19:20.601567 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.601471 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gj675\"" Jun 15 03:19:20.601801 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.601737 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603222 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603316 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603388 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603582 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603592 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 03:19:20.604334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.603794 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 03:19:20.613901 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.613879 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 03:19:20.710497 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-web-config\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710497 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-out\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710497 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710497 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pd2\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-kube-api-access-l5pd2\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.710890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.710794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.812957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.812902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.812957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.812965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-web-config\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.812991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-out\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813030 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pd2\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-kube-api-access-l5pd2\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813774 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813774 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.813883 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.813805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.814090 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.814051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.814932 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.814911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.815035 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:20.815008 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 03:19:20.815197 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:20.815123 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls podName:2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c nodeName:}" failed. No retries permitted until 2026-06-15 03:19:21.31510222 +0000 UTC m=+80.759296919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c") : secret "alertmanager-main-tls" not found Jun 15 03:19:20.817037 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.816995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-out\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.817214 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.817191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.818411 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.818211 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.818660 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.818637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-web-config\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.819012 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.818700 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.820180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.819553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.820180 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.819602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.820912 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.820850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.821205 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.821188 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pd2\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-kube-api-access-l5pd2\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:20.974615 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:20.974582 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:21.318099 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:21.317997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:21.321031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:21.321006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:21.511535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:21.511499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:19:22.461952 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:22.461865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:22.549457 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:22.549416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:22.620104 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:22.620040 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:22.717634 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:22.717551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:22.969548 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:22.969480 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:24.315642 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.315606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:24.323316 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.323282 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-6s97w"] Jun 15 03:19:24.385750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.385716 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-6s97w"] Jun 15 03:19:24.385914 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.385830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.388661 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.388638 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b4hjk\"" Jun 15 03:19:24.388797 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.388670 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 03:19:24.397601 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.397580 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:24.493276 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.493245 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6597f8f9bb-nlgrt"] Jun 15 03:19:24.544251 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.544220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/869a521a-fb7f-415f-9685-d14d86b5967e-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-6s97w\" (UID: \"869a521a-fb7f-415f-9685-d14d86b5967e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.544404 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.544339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qckcx\" (UniqueName: \"kubernetes.io/projected/869a521a-fb7f-415f-9685-d14d86b5967e-kube-api-access-qckcx\") pod \"monitoring-plugin-589576dfc7-6s97w\" (UID: \"869a521a-fb7f-415f-9685-d14d86b5967e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.644776 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.644740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/869a521a-fb7f-415f-9685-d14d86b5967e-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-6s97w\" (UID: \"869a521a-fb7f-415f-9685-d14d86b5967e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.644942 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.644828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qckcx\" (UniqueName: \"kubernetes.io/projected/869a521a-fb7f-415f-9685-d14d86b5967e-kube-api-access-qckcx\") pod \"monitoring-plugin-589576dfc7-6s97w\" (UID: \"869a521a-fb7f-415f-9685-d14d86b5967e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.647611 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.647586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/869a521a-fb7f-415f-9685-d14d86b5967e-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-6s97w\" (UID: \"869a521a-fb7f-415f-9685-d14d86b5967e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.654708 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.654617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qckcx\" (UniqueName: \"kubernetes.io/projected/869a521a-fb7f-415f-9685-d14d86b5967e-kube-api-access-qckcx\") pod \"monitoring-plugin-589576dfc7-6s97w\" (UID: \"869a521a-fb7f-415f-9685-d14d86b5967e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.668176 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.667829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:24.696911 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.696883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:24.888208 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.888176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:24.934408 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:24.932097 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b988a1_3763_4da1_8819_044c925d9b51.slice/crio-ccf8406e421b2f144be919ffc896bcf9084a901701f097c89696b76872d22315 WatchSource:0}: Error finding container ccf8406e421b2f144be919ffc896bcf9084a901701f097c89696b76872d22315: Status 404 returned error can't find the container with id ccf8406e421b2f144be919ffc896bcf9084a901701f097c89696b76872d22315 Jun 15 03:19:24.987616 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:24.987575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:25.084895 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.084858 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-6s97w"] Jun 15 03:19:25.086955 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.086917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:25.087927 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:25.087899 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869a521a_fb7f_415f_9685_d14d86b5967e.slice/crio-5190e5d0219e54820e2347dc685d7b64f83ef5c2e088ab63f2bd880fb8911482 WatchSource:0}: Error finding container 5190e5d0219e54820e2347dc685d7b64f83ef5c2e088ab63f2bd880fb8911482: Status 404 returned error can't find the container with id 5190e5d0219e54820e2347dc685d7b64f83ef5c2e088ab63f2bd880fb8911482 Jun 15 03:19:25.102877 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.102845 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6597f8f9bb-nlgrt"] Jun 15 03:19:25.105809 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:25.105780 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4e2f51_c49b_4206_85e1_0f2e7995fcf4.slice/crio-bb6f6087f43f330fdaad81474a98aeb19431cd7a8384fee4454db4b2b82a37a0 WatchSource:0}: Error finding container bb6f6087f43f330fdaad81474a98aeb19431cd7a8384fee4454db4b2b82a37a0: Status 404 returned error can't find the container with id bb6f6087f43f330fdaad81474a98aeb19431cd7a8384fee4454db4b2b82a37a0 Jun 15 03:19:25.142575 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.142545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:25.165676 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.165657 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 03:19:25.303836 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:25.303808 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbb8ba3_b539_43b9_9ea5_2d1c58cc510c.slice/crio-38a85a2dbc902e2652f64badfae467ca9524c54f542e4df80b729d9110ed8710 WatchSource:0}: Error finding container 38a85a2dbc902e2652f64badfae467ca9524c54f542e4df80b729d9110ed8710: Status 404 returned error can't find the container with id 38a85a2dbc902e2652f64badfae467ca9524c54f542e4df80b729d9110ed8710 Jun 15 03:19:25.332663 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.332641 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9"] Jun 15 03:19:25.334444 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:25.334426 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df3111b_f879_4a06_bf86_70bc22ef645e.slice/crio-554ca1d8eeebc6b1fa996c5b2cdee49fdd16d6a10217c2fdd3a862c2de947fae WatchSource:0}: Error finding container 554ca1d8eeebc6b1fa996c5b2cdee49fdd16d6a10217c2fdd3a862c2de947fae: Status 404 returned error can't find the container with id 554ca1d8eeebc6b1fa996c5b2cdee49fdd16d6a10217c2fdd3a862c2de947fae Jun 15 03:19:25.340313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.340288 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg"] Jun 15 03:19:25.341812 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:25.341795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11a57d1_f57f_434d_91e5_45854465be37.slice/crio-780aaf9c858b720404474a1d9f3c5e03807fc8025bf73179692377c38a83b73a WatchSource:0}: Error finding container 780aaf9c858b720404474a1d9f3c5e03807fc8025bf73179692377c38a83b73a: Status 404 returned error can't find the container with id 780aaf9c858b720404474a1d9f3c5e03807fc8025bf73179692377c38a83b73a Jun 15 03:19:25.444577 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.444532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" event={"ID":"869a521a-fb7f-415f-9685-d14d86b5967e","Type":"ContainerStarted","Data":"5190e5d0219e54820e2347dc685d7b64f83ef5c2e088ab63f2bd880fb8911482"} Jun 15 03:19:25.445916 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.445852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" event={"ID":"c11a57d1-f57f-434d-91e5-45854465be37","Type":"ContainerStarted","Data":"780aaf9c858b720404474a1d9f3c5e03807fc8025bf73179692377c38a83b73a"} Jun 15 03:19:25.447517 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.447490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"38a85a2dbc902e2652f64badfae467ca9524c54f542e4df80b729d9110ed8710"} Jun 15 03:19:25.448948 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.448892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89rzh" event={"ID":"e4b988a1-3763-4da1-8819-044c925d9b51","Type":"ContainerStarted","Data":"ccf8406e421b2f144be919ffc896bcf9084a901701f097c89696b76872d22315"} Jun 15 03:19:25.451009 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.450961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" event={"ID":"8df3111b-f879-4a06-bf86-70bc22ef645e","Type":"ContainerStarted","Data":"8baa917dc0b42a8877084e818181e81d10d338e3ceac6b264374cb3f75df6198"} Jun 15 03:19:25.451110 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.451014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" event={"ID":"8df3111b-f879-4a06-bf86-70bc22ef645e","Type":"ContainerStarted","Data":"554ca1d8eeebc6b1fa996c5b2cdee49fdd16d6a10217c2fdd3a862c2de947fae"} Jun 15 03:19:25.453480 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.453457 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6597f8f9bb-nlgrt" event={"ID":"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4","Type":"ContainerStarted","Data":"bb6f6087f43f330fdaad81474a98aeb19431cd7a8384fee4454db4b2b82a37a0"} Jun 15 03:19:25.740902 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.740865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:25.750715 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.749277 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:19:25.755236 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.755212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.758386 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.758352 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 03:19:25.759000 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.758682 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 03:19:25.759000 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.758901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a49jtdoc64mpf\"" Jun 15 03:19:25.760087 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.760066 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 03:19:25.760365 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.760347 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dr6gj\"" Jun 15 03:19:25.760703 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.760665 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 03:19:25.761051 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761025 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 03:19:25.761668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761328 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 03:19:25.761668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761524 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 03:19:25.761668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 03:19:25.761865 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 03:19:25.761918 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761874 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 03:19:25.761969 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.761938 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 03:19:25.762456 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.762440 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 03:19:25.762456 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.763546 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 03:19:25.762456 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.763760 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 03:19:25.766932 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.766813 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 03:19:25.783761 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.781106 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.853926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.853993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-config-out\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.854506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.854271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-web-config\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqb9s\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-kube-api-access-bqb9s\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-config\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.855656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.855526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-config-out\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956285 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-web-config\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.957191 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.956610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqb9s\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-kube-api-access-bqb9s\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958048 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958225 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958292 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-config\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958348 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958402 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958451 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958594 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958594 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958502 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.958939 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.958915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.961523 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.961496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.961682 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.961562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.962692 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.962183 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.963213 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.963188 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.964013 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.963705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.964013 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.963918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.967992 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.967959 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-config-out\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.973512 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.973489 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqb9s\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-kube-api-access-bqb9s\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.975745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.974787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.975745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.975060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-config\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.975745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.975107 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.975745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.975305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.975745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.975511 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.975745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.975708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-web-config\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.976079 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.975812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.979905 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.979883 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.980384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.980337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:25.980476 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:25.980460 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:26.078175 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.078126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:26.333770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.333328 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54f6896464-8pgmc" Jun 15 03:19:26.476433 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.476395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-7dm2x" event={"ID":"de7f22e9-5d98-41d7-97ec-3285990ea747","Type":"ContainerStarted","Data":"d17171f08b11811ca6feb77406715de6a834acbd693bd86c934582db7f610ddd"} Jun 15 03:19:26.477303 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.477245 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:26.480015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.479923 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" event={"ID":"8df3111b-f879-4a06-bf86-70bc22ef645e","Type":"ContainerStarted","Data":"e287af077d27e1b6647aff7bb5d203cba8d933254a72047fd55b1f260d57bbbf"} Jun 15 03:19:26.484433 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.484382 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-7dm2x" Jun 15 03:19:26.497328 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.496403 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-7dm2x" podStartSLOduration=1.812333889 podStartE2EDuration="23.49638406s" totalImagesPullingTime="21.684050171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:26.495858367 +0000 UTC m=+85.940053098" watchObservedRunningTime="2026-06-15 03:19:26.49638406 +0000 UTC m=+85.940578815" Jun 15 03:19:26.500930 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.500835 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:26.601317 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.601286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:26.700819 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.700758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:26.889262 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.889020 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:19:26.891638 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.891356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:26.958677 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:26.958608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:27.031640 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:19:27.031547 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997e3a51_357b_42e1_98f4_09df69b65df4.slice/crio-0e1565edf2d5eba246cb8e76299c918e6eb4ec368d924f1c2f79ccf21dfc8089 WatchSource:0}: Error finding container 0e1565edf2d5eba246cb8e76299c918e6eb4ec368d924f1c2f79ccf21dfc8089: Status 404 returned error can't find the container with id 0e1565edf2d5eba246cb8e76299c918e6eb4ec368d924f1c2f79ccf21dfc8089 Jun 15 03:19:27.488241 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:27.488206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"0e1565edf2d5eba246cb8e76299c918e6eb4ec368d924f1c2f79ccf21dfc8089"} Jun 15 03:19:28.018288 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:28.018253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:28.076982 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:28.076898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:28.150742 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:28.150694 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" podUID="e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" containerName="registry" containerID="cri-o://4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446" gracePeriod=30 Jun 15 03:19:31.492973 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.492945 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:19:31.509006 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.508939 2559 generic.go:356] "Generic (PLEG): container finished" podID="e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" containerID="4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446" exitCode=0 Jun 15 03:19:31.509006 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.508979 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" Jun 15 03:19:31.509006 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.508993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" event={"ID":"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b","Type":"ContainerDied","Data":"4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446"} Jun 15 03:19:31.509241 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.509055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9479b4975-fhkbh" event={"ID":"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b","Type":"ContainerDied","Data":"e485dbaa06a31d91ce5c2a6c7f5353fb2fd4722335385a7da67efa6d9c4d7db5"} Jun 15 03:19:31.509241 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.509087 2559 scope.go:117] "RemoveContainer" containerID="4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446" Jun 15 03:19:31.549683 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.549659 2559 scope.go:117] "RemoveContainer" containerID="4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446" Jun 15 03:19:31.550078 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:31.550045 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446\": container with ID starting with 4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446 not found: ID does not exist" containerID="4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446" Jun 15 03:19:31.550208 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.550088 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446"} err="failed to get container status \"4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446\": rpc error: code = NotFound desc = could not find container \"4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446\": container with ID starting with 4be2854bce14ac7dae123afa70c47301602948bbd0900ff10131ee655c051446 not found: ID does not exist" Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637356 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-certificates\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637420 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-image-registry-private-configuration\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637442 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-trusted-ca\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637473 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-installation-pull-secrets\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637496 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhbpv\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-kube-api-access-xhbpv\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637522 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-ca-trust-extracted\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637557 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.637705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.637574 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-bound-sa-token\") pod \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\" (UID: \"e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b\") " Jun 15 03:19:31.638737 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.638303 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:31.638737 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.638347 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:31.641423 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.641376 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:19:31.641705 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.641666 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-kube-api-access-xhbpv" (OuterVolumeSpecName: "kube-api-access-xhbpv") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "kube-api-access-xhbpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:31.641894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.641864 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:19:31.642370 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.642330 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:31.642852 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.642831 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:31.649535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.649510 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" (UID: "e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738611 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-image-registry-private-configuration\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738641 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-trusted-ca\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738656 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-installation-pull-secrets\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738669 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhbpv\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-kube-api-access-xhbpv\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738684 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-ca-trust-extracted\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738696 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-tls\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738711 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-bound-sa-token\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.738864 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.738733 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b-registry-certificates\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:31.840581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.840551 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9479b4975-fhkbh"] Jun 15 03:19:31.845004 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:31.844371 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9479b4975-fhkbh"] Jun 15 03:19:32.166423 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.166342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:32.266790 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.266732 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:32.515829 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.515795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" event={"ID":"869a521a-fb7f-415f-9685-d14d86b5967e","Type":"ContainerStarted","Data":"d41fb0d3ccb30b6205fae2cb043b3bd3283096421c56dddcd5ebe432c428bf4d"} Jun 15 03:19:32.516322 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.516003 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:32.518489 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.518460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" event={"ID":"c11a57d1-f57f-434d-91e5-45854465be37","Type":"ContainerStarted","Data":"01881759f94713f4be4d30df8af22b430185f46d01cafb54fc3a4d82746d245e"} Jun 15 03:19:32.518608 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.518523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" event={"ID":"c11a57d1-f57f-434d-91e5-45854465be37","Type":"ContainerStarted","Data":"1d7a1f5243e6367ed4ed76bd1d1b65cd96e47312bb0851064f0236f26f312cae"} Jun 15 03:19:32.518608 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.518560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" event={"ID":"c11a57d1-f57f-434d-91e5-45854465be37","Type":"ContainerStarted","Data":"51853fcc246472406309cb64ed64599392ad981cc9345e15b310b4a99c499369"} Jun 15 03:19:32.520483 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.520455 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3" exitCode=0 Jun 15 03:19:32.520583 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.520562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3"} Jun 15 03:19:32.522654 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.522633 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" Jun 15 03:19:32.524183 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.524138 2559 generic.go:356] "Generic (PLEG): container finished" podID="e4b988a1-3763-4da1-8819-044c925d9b51" containerID="8018a19d5510aacfc09ea0c0773486d7614c2fa28b20eaff0460164664eef762" exitCode=0 Jun 15 03:19:32.524282 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.524264 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89rzh" event={"ID":"e4b988a1-3763-4da1-8819-044c925d9b51","Type":"ContainerDied","Data":"8018a19d5510aacfc09ea0c0773486d7614c2fa28b20eaff0460164664eef762"} Jun 15 03:19:32.527270 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.527248 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" event={"ID":"8df3111b-f879-4a06-bf86-70bc22ef645e","Type":"ContainerStarted","Data":"90084343b05afbc269ab7d6bb62ba9c1487bbd889e065077fe1c2763fcbf811c"} Jun 15 03:19:32.532790 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.530823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6597f8f9bb-nlgrt" event={"ID":"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4","Type":"ContainerStarted","Data":"3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256"} Jun 15 03:19:32.535792 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.533550 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" exitCode=0 Jun 15 03:19:32.535792 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.533584 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} Jun 15 03:19:32.535792 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.533972 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6s97w" podStartSLOduration=2.067827938 podStartE2EDuration="8.533956673s" totalImagesPullingTime="6.466128735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:32.531744888 +0000 UTC m=+91.975939595" watchObservedRunningTime="2026-06-15 03:19:32.533956673 +0000 UTC m=+91.978151381" Jun 15 03:19:32.573028 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.572204 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6597f8f9bb-nlgrt" podStartSLOduration=7.319044104 podStartE2EDuration="13.572185678s" totalImagesPullingTime="6.253141574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:32.571363482 +0000 UTC m=+92.015558203" watchObservedRunningTime="2026-06-15 03:19:32.572185678 +0000 UTC m=+92.016380400" Jun 15 03:19:32.609761 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.609712 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-jrzxg" podStartSLOduration=7.393761602 podStartE2EDuration="13.609693236s" totalImagesPullingTime="6.215931634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:32.608504796 +0000 UTC m=+92.052699524" watchObservedRunningTime="2026-06-15 03:19:32.609693236 +0000 UTC m=+92.053887944" Jun 15 03:19:32.644810 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:32.644761 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-tdmf9" podStartSLOduration=7.664782369 podStartE2EDuration="13.64474197s" totalImagesPullingTime="5.979959601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:32.6437076 +0000 UTC m=+92.087902306" watchObservedRunningTime="2026-06-15 03:19:32.64474197 +0000 UTC m=+92.088936678" Jun 15 03:19:33.047792 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:33.047717 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" path="/var/lib/kubelet/pods/e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b/volumes" Jun 15 03:19:33.547178 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:33.546461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89rzh" event={"ID":"e4b988a1-3763-4da1-8819-044c925d9b51","Type":"ContainerStarted","Data":"fada8620747d48fe78c09934968a146b28f5131d7301087352265b3387409535"} Jun 15 03:19:33.547752 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:33.547718 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89rzh" event={"ID":"e4b988a1-3763-4da1-8819-044c925d9b51","Type":"ContainerStarted","Data":"6558bfee29988d6405afd77e53c4830fbe648f034165ccc3fbfaaf3cd1a39228"} Jun 15 03:19:33.571969 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:33.571917 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-89rzh" podStartSLOduration=11.356148517 podStartE2EDuration="14.571896532s" totalImagesPullingTime="3.06625288s" totalInitContainerRuntime="149.495135ms" isStatefulPod=true podCreationTimestamp="2026-06-15 03:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:33.567886984 +0000 UTC m=+93.012081691" watchObservedRunningTime="2026-06-15 03:19:33.571896532 +0000 UTC m=+93.016091239" Jun 15 03:19:35.537591 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:35.537549 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:35.774793 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:35.774747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:35.873785 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:35.873702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:35.973318 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:35.973284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:36.561615 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:36.561589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe"} Jun 15 03:19:36.561997 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:36.561665 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee"} Jun 15 03:19:37.570308 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:37.570270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} Jun 15 03:19:37.570863 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:37.570365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} Jun 15 03:19:37.575314 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:37.575286 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055"} Jun 15 03:19:37.575440 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:37.575359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b"} Jun 15 03:19:37.575440 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:37.575397 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71"} Jun 15 03:19:39.588018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.587981 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} Jun 15 03:19:39.588441 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.588051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} Jun 15 03:19:39.588441 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.588082 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} Jun 15 03:19:39.588441 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.588123 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerStarted","Data":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} Jun 15 03:19:39.591289 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.591266 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerStarted","Data":"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0"} Jun 15 03:19:39.616635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.616434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:39.619550 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.619495 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.785379763 podStartE2EDuration="14.619475757s" totalImagesPullingTime="10.800893781s" totalInitContainerRuntime="33.202213ms" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:39.616015469 +0000 UTC m=+99.060210177" watchObservedRunningTime="2026-06-15 03:19:39.619475757 +0000 UTC m=+99.063670465" Jun 15 03:19:39.645464 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:39.645422 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.920971858 podStartE2EDuration="19.645411412s" totalImagesPullingTime="9.706668303s" totalInitContainerRuntime="17.771251ms" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:39.643360284 +0000 UTC m=+99.087555004" watchObservedRunningTime="2026-06-15 03:19:39.645411412 +0000 UTC m=+99.089606118" Jun 15 03:19:41.079477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:41.079447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:19:41.085221 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:41.085195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:41.137034 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:41.137011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:41.701062 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:41.701030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:41.753008 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:41.752986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:43.021379 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:43.021342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:43.123516 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:43.123490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:46.404840 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:46.404811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v4hp7" Jun 15 03:19:50.285648 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:50.285617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bmdl_e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea/serve-healthcheck-canary/0.log" Jun 15 03:19:54.092582 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:54.092551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:54.194887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:54.194861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:54.256104 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:54.256074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:57.559622 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.559579 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6597f8f9bb-nlgrt" podUID="cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" containerName="console" containerID="cri-o://3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256" gracePeriod=15 Jun 15 03:19:57.835601 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.835553 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:57.950380 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950358 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6qck\" (UniqueName: \"kubernetes.io/projected/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-kube-api-access-j6qck\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950534 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-oauth-config\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950534 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950421 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-oauth-serving-cert\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950534 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950448 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-trusted-ca-bundle\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950553 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-serving-cert\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950640 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-service-ca\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950694 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-config\") pod \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\" (UID: \"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4\") " Jun 15 03:19:57.950974 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950858 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:57.950974 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.950957 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:57.951214 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.951038 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:57.951270 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.951252 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-config" (OuterVolumeSpecName: "console-config") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:57.952830 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.952796 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:19:57.953123 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.953099 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-kube-api-access-j6qck" (OuterVolumeSpecName: "kube-api-access-j6qck") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "kube-api-access-j6qck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:57.953123 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:57.953101 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" (UID: "cc4e2f51-c49b-4206-85e1-0f2e7995fcf4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:19:58.017981 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.017958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:58.052275 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052257 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-service-ca\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.052275 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052274 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-config\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.052367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052285 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6qck\" (UniqueName: \"kubernetes.io/projected/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-kube-api-access-j6qck\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.052367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052294 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-oauth-config\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.052367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052302 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-oauth-serving-cert\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.052367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052311 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-trusted-ca-bundle\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.052367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.052320 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4-console-serving-cert\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:19:58.068498 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.068472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:19:58.668293 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.668258 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" containerID="3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256" exitCode=0 Jun 15 03:19:58.668729 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.668303 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6597f8f9bb-nlgrt" Jun 15 03:19:58.668729 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.668343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6597f8f9bb-nlgrt" event={"ID":"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4","Type":"ContainerDied","Data":"3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256"} Jun 15 03:19:58.668729 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.668392 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6597f8f9bb-nlgrt" event={"ID":"cc4e2f51-c49b-4206-85e1-0f2e7995fcf4","Type":"ContainerDied","Data":"bb6f6087f43f330fdaad81474a98aeb19431cd7a8384fee4454db4b2b82a37a0"} Jun 15 03:19:58.668729 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.668413 2559 scope.go:117] "RemoveContainer" containerID="3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256" Jun 15 03:19:58.677206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.677191 2559 scope.go:117] "RemoveContainer" containerID="3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256" Jun 15 03:19:58.677464 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:19:58.677444 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256\": container with ID starting with 3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256 not found: ID does not exist" containerID="3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256" Jun 15 03:19:58.677515 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.677471 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256"} err="failed to get container status \"3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256\": rpc error: code = NotFound desc = could not find container \"3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256\": container with ID starting with 3485fcc85db282719f92444f87d04ed35b69d71cd57d41d8608fdbc0518f8256 not found: ID does not exist" Jun 15 03:19:58.694848 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.694824 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6597f8f9bb-nlgrt"] Jun 15 03:19:58.696116 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:58.696098 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6597f8f9bb-nlgrt"] Jun 15 03:19:59.046179 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:19:59.046103 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" path="/var/lib/kubelet/pods/cc4e2f51-c49b-4206-85e1-0f2e7995fcf4/volumes" Jun 15 03:20:03.006998 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:03.006965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:03.061131 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:03.061092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:11.082107 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:11.082073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:11.140021 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:11.139988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:14.840421 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:14.840383 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:26.079210 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:26.079177 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:26.096999 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:26.096976 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:26.803372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:26.803331 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:38.727784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:38.727746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:39.234822 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.234780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:39.792737 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.792702 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 03:20:39.793140 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.792975 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="alertmanager" containerID="cri-o://0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee" gracePeriod=120 Jun 15 03:20:39.793140 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.793064 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-metric" containerID="cri-o://e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055" gracePeriod=120 Jun 15 03:20:39.793140 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.793112 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="prom-label-proxy" containerID="cri-o://9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0" gracePeriod=120 Jun 15 03:20:39.793140 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.793140 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy" containerID="cri-o://547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b" gracePeriod=120 Jun 15 03:20:39.793396 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.793256 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="config-reloader" containerID="cri-o://a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe" gracePeriod=120 Jun 15 03:20:39.793396 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:39.793258 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-web" containerID="cri-o://f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71" gracePeriod=120 Jun 15 03:20:40.772794 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.772760 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:40.851966 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.851937 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0" exitCode=0 Jun 15 03:20:40.851966 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.851963 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b" exitCode=0 Jun 15 03:20:40.851966 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.851970 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe" exitCode=0 Jun 15 03:20:40.851966 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.851976 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee" exitCode=0 Jun 15 03:20:40.852535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.852015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0"} Jun 15 03:20:40.852535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.852108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b"} Jun 15 03:20:40.852535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.852187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe"} Jun 15 03:20:40.852535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:40.852231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee"} Jun 15 03:20:41.035356 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.035300 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:20:41.190052 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190024 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-out\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190052 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190057 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-web\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190074 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-volume\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190094 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190114 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-web-config\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190136 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190195 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-tls-assets\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190242 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-metrics-client-ca\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190295 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-trusted-ca-bundle\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190328 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190352 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-cluster-tls-config\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190384 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5pd2\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-kube-api-access-l5pd2\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190409 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-main-db\") pod \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\" (UID: \"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c\") " Jun 15 03:20:41.190929 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190898 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:41.190995 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.190913 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:20:41.192686 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.192656 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.192949 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.192920 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-out" (OuterVolumeSpecName: "config-out") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:20:41.193301 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.193267 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.193510 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.193451 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:20:41.193510 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.193472 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.193510 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.193474 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-volume" (OuterVolumeSpecName: "config-volume") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.193695 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.193600 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:41.194121 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.194093 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.194939 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.194922 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-kube-api-access-l5pd2" (OuterVolumeSpecName: "kube-api-access-l5pd2") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "kube-api-access-l5pd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:20:41.199498 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.199476 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.203782 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.203762 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-web-config" (OuterVolumeSpecName: "web-config") pod "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" (UID: "2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:41.291480 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291429 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291480 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291451 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291480 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291462 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-cluster-tls-config\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291480 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291471 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5pd2\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-kube-api-access-l5pd2\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291480 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291479 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-alertmanager-main-db\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291487 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-out\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291495 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291503 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-config-volume\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291516 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-main-tls\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291528 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-web-config\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291535 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291543 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-tls-assets\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.291662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.291551 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c-metrics-client-ca\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:41.860901 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.860870 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055" exitCode=0 Jun 15 03:20:41.860901 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.860896 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerID="f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71" exitCode=0 Jun 15 03:20:41.861372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.860935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055"} Jun 15 03:20:41.861372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.861000 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 03:20:41.861372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.861015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71"} Jun 15 03:20:41.861372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.861042 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c","Type":"ContainerDied","Data":"38a85a2dbc902e2652f64badfae467ca9524c54f542e4df80b729d9110ed8710"} Jun 15 03:20:41.861372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.861084 2559 scope.go:117] "RemoveContainer" containerID="9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0" Jun 15 03:20:41.870954 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.870939 2559 scope.go:117] "RemoveContainer" containerID="e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055" Jun 15 03:20:41.877780 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.877763 2559 scope.go:117] "RemoveContainer" containerID="547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b" Jun 15 03:20:41.884135 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.884119 2559 scope.go:117] "RemoveContainer" containerID="f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71" Jun 15 03:20:41.887545 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.887523 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 03:20:41.891255 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.891236 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 03:20:41.891779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.891767 2559 scope.go:117] "RemoveContainer" containerID="a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe" Jun 15 03:20:41.898189 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.898173 2559 scope.go:117] "RemoveContainer" containerID="0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee" Jun 15 03:20:41.905098 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.904992 2559 scope.go:117] "RemoveContainer" containerID="8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3" Jun 15 03:20:41.911918 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.911903 2559 scope.go:117] "RemoveContainer" containerID="9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0" Jun 15 03:20:41.912187 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.912170 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0\": container with ID starting with 9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0 not found: ID does not exist" containerID="9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0" Jun 15 03:20:41.912267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912197 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0"} err="failed to get container status \"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0\": rpc error: code = NotFound desc = could not find container \"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0\": container with ID starting with 9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0 not found: ID does not exist" Jun 15 03:20:41.912267 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912221 2559 scope.go:117] "RemoveContainer" containerID="e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055" Jun 15 03:20:41.912444 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.912425 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055\": container with ID starting with e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055 not found: ID does not exist" containerID="e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055" Jun 15 03:20:41.912486 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912449 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055"} err="failed to get container status \"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055\": rpc error: code = NotFound desc = could not find container \"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055\": container with ID starting with e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055 not found: ID does not exist" Jun 15 03:20:41.912486 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912464 2559 scope.go:117] "RemoveContainer" containerID="547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b" Jun 15 03:20:41.912651 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.912635 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b\": container with ID starting with 547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b not found: ID does not exist" containerID="547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b" Jun 15 03:20:41.912715 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912654 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b"} err="failed to get container status \"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b\": rpc error: code = NotFound desc = could not find container \"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b\": container with ID starting with 547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b not found: ID does not exist" Jun 15 03:20:41.912715 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912667 2559 scope.go:117] "RemoveContainer" containerID="f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71" Jun 15 03:20:41.912873 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.912859 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71\": container with ID starting with f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71 not found: ID does not exist" containerID="f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71" Jun 15 03:20:41.912932 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912874 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71"} err="failed to get container status \"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71\": rpc error: code = NotFound desc = could not find container \"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71\": container with ID starting with f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71 not found: ID does not exist" Jun 15 03:20:41.912932 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.912884 2559 scope.go:117] "RemoveContainer" containerID="a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe" Jun 15 03:20:41.913106 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.913087 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe\": container with ID starting with a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe not found: ID does not exist" containerID="a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe" Jun 15 03:20:41.913173 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.913111 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe"} err="failed to get container status \"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe\": rpc error: code = NotFound desc = could not find container \"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe\": container with ID starting with a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe not found: ID does not exist" Jun 15 03:20:41.913173 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.913126 2559 scope.go:117] "RemoveContainer" containerID="0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee" Jun 15 03:20:41.913427 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.913407 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee\": container with ID starting with 0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee not found: ID does not exist" containerID="0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee" Jun 15 03:20:41.913521 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.913429 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee"} err="failed to get container status \"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee\": rpc error: code = NotFound desc = could not find container \"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee\": container with ID starting with 0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee not found: ID does not exist" Jun 15 03:20:41.913521 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.913451 2559 scope.go:117] "RemoveContainer" containerID="8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3" Jun 15 03:20:41.913695 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:41.913675 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3\": container with ID starting with 8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3 not found: ID does not exist" containerID="8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3" Jun 15 03:20:41.913759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.913703 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3"} err="failed to get container status \"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3\": rpc error: code = NotFound desc = could not find container \"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3\": container with ID starting with 8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3 not found: ID does not exist" Jun 15 03:20:41.913759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.913723 2559 scope.go:117] "RemoveContainer" containerID="9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0" Jun 15 03:20:41.914098 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914078 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0"} err="failed to get container status \"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0\": rpc error: code = NotFound desc = could not find container \"9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0\": container with ID starting with 9c5d457fd00c2e91cb5a7c5322d569f019713b0cfef558f87a30e1dbc2a045c0 not found: ID does not exist" Jun 15 03:20:41.914098 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914100 2559 scope.go:117] "RemoveContainer" containerID="e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055" Jun 15 03:20:41.914437 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914412 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055"} err="failed to get container status \"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055\": rpc error: code = NotFound desc = could not find container \"e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055\": container with ID starting with e7c615ac2333df572fc8510a121b0004a0db57a306db75938aac7604a5a9e055 not found: ID does not exist" Jun 15 03:20:41.914522 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914439 2559 scope.go:117] "RemoveContainer" containerID="547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b" Jun 15 03:20:41.914683 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914664 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b"} err="failed to get container status \"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b\": rpc error: code = NotFound desc = could not find container \"547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b\": container with ID starting with 547c0def59d53fc408086fc832eb7ecc729a48c1dcd0b2f4f2a4ecf7c1c18e2b not found: ID does not exist" Jun 15 03:20:41.914733 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914683 2559 scope.go:117] "RemoveContainer" containerID="f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71" Jun 15 03:20:41.914900 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914885 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71"} err="failed to get container status \"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71\": rpc error: code = NotFound desc = could not find container \"f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71\": container with ID starting with f20486ab1bdf8cbca96bc49853c79141a8288c4aef35a5c6c606f9f2afa92a71 not found: ID does not exist" Jun 15 03:20:41.914945 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.914901 2559 scope.go:117] "RemoveContainer" containerID="a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe" Jun 15 03:20:41.915104 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.915086 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe"} err="failed to get container status \"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe\": rpc error: code = NotFound desc = could not find container \"a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe\": container with ID starting with a798773094c4fc0e9b3bc1cb268ca0984e62af6e7cc4257511b55537e51d98fe not found: ID does not exist" Jun 15 03:20:41.915214 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.915105 2559 scope.go:117] "RemoveContainer" containerID="0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee" Jun 15 03:20:41.915341 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.915324 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee"} err="failed to get container status \"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee\": rpc error: code = NotFound desc = could not find container \"0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee\": container with ID starting with 0a846a7ae961525f2184dd1b38d55b8bf3733be997bdf5f07882b4ac24e55dee not found: ID does not exist" Jun 15 03:20:41.915406 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.915343 2559 scope.go:117] "RemoveContainer" containerID="8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3" Jun 15 03:20:41.915580 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:41.915564 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3"} err="failed to get container status \"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3\": rpc error: code = NotFound desc = could not find container \"8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3\": container with ID starting with 8eee2c7fc4ece0a0a5449d4faf86d07b5edba6f45f03a91b7a0686e3e84dc6a3 not found: ID does not exist" Jun 15 03:20:43.046345 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:43.046314 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" path="/var/lib/kubelet/pods/2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c/volumes" Jun 15 03:20:44.100692 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.100660 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:20:44.101672 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.101639 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="prometheus" containerID="cri-o://6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" gracePeriod=600 Jun 15 03:20:44.102052 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.102016 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="thanos-sidecar" containerID="cri-o://26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" gracePeriod=600 Jun 15 03:20:44.102190 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.102027 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="config-reloader" containerID="cri-o://1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" gracePeriod=600 Jun 15 03:20:44.102190 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.102077 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-web" containerID="cri-o://b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" gracePeriod=600 Jun 15 03:20:44.102190 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.102006 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" gracePeriod=600 Jun 15 03:20:44.102190 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.102128 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy" containerID="cri-o://3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" gracePeriod=600 Jun 15 03:20:44.349833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.349810 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:44.515926 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.515896 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-kubelet-serving-ca-bundle\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.515926 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.515927 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-0\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.515950 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-serving-certs-ca-bundle\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.515971 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-2\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.515987 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-1\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516054 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqb9s\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-kube-api-access-bqb9s\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516095 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-grpc-tls\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516125 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-kube-rbac-proxy\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516189 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-trusted-ca-bundle\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516220 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-config\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516343 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.516468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516390 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.516468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516398 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.516468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516464 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.516770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516638 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516676 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-tls\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516708 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-db\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.516770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516722 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.516770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516746 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-metrics-client-ca\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516782 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-thanos-prometheus-http-client-file\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516818 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-config-out\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516843 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-tls-assets\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516884 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516913 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-metrics-client-certs\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517031 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.516938 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-web-config\") pod \"997e3a51-357b-42e1-98f4-09df69b65df4\" (UID: \"997e3a51-357b-42e1-98f4-09df69b65df4\") " Jun 15 03:20:44.517415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.517126 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.517415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.517224 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.517415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.517244 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.517415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.517260 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.517415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.517273 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.517415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.517286 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.518873 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.518685 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-kube-api-access-bqb9s" (OuterVolumeSpecName: "kube-api-access-bqb9s") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "kube-api-access-bqb9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:20:44.518873 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.518735 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-config" (OuterVolumeSpecName: "config") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.519070 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.518934 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.519070 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.518996 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.519808 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.519359 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:44.519808 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.519362 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.519808 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.519695 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.520214 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.520184 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-config-out" (OuterVolumeSpecName: "config-out") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:20:44.520380 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.520357 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:20:44.520713 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.520690 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:20:44.520957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.520933 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.521106 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.521083 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.521313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.521296 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.530547 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.530527 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-web-config" (OuterVolumeSpecName: "web-config") pod "997e3a51-357b-42e1-98f4-09df69b65df4" (UID: "997e3a51-357b-42e1-98f4-09df69b65df4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:44.617735 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617713 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-db\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617735 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617733 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-configmap-metrics-client-ca\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617744 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617753 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/997e3a51-357b-42e1-98f4-09df69b65df4-config-out\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617761 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-tls-assets\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617769 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617779 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-metrics-client-certs\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617787 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-web-config\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617795 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/997e3a51-357b-42e1-98f4-09df69b65df4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617803 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqb9s\" (UniqueName: \"kubernetes.io/projected/997e3a51-357b-42e1-98f4-09df69b65df4-kube-api-access-bqb9s\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617812 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-grpc-tls\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617820 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-kube-rbac-proxy\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617827 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-config\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617835 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.617851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.617843 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/997e3a51-357b-42e1-98f4-09df69b65df4-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:20:44.877604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877526 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" exitCode=0 Jun 15 03:20:44.877604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877557 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" exitCode=0 Jun 15 03:20:44.877604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877566 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" exitCode=0 Jun 15 03:20:44.877604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877575 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" exitCode=0 Jun 15 03:20:44.877604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877583 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" exitCode=0 Jun 15 03:20:44.877604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877591 2559 generic.go:356] "Generic (PLEG): container finished" podID="997e3a51-357b-42e1-98f4-09df69b65df4" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" exitCode=0 Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877623 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877664 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877739 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877740 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} Jun 15 03:20:44.877882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877861 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} Jun 15 03:20:44.878219 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.877905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"997e3a51-357b-42e1-98f4-09df69b65df4","Type":"ContainerDied","Data":"0e1565edf2d5eba246cb8e76299c918e6eb4ec368d924f1c2f79ccf21dfc8089"} Jun 15 03:20:44.890554 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.890537 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.897647 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.897627 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.903569 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.903548 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:20:44.905189 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.905143 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.906506 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.906484 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:20:44.911757 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.911741 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.917988 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.917970 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.925059 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.925041 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.929757 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.929734 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:20:44.930017 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930006 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="init-config-reloader" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930019 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="init-config-reloader" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930030 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="init-config-reloader" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930035 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="init-config-reloader" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930047 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930052 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930059 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy" Jun 15 03:20:44.930061 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930063 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930070 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-web" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930076 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-web" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930082 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-metric" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930087 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-metric" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930093 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" containerName="registry" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930098 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" containerName="registry" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930106 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" containerName="console" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930111 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" containerName="console" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930118 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="prometheus" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930123 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="prometheus" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930129 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-thanos" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930134 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-thanos" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930140 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="alertmanager" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930163 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="alertmanager" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930172 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-web" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930178 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-web" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930184 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="config-reloader" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930189 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="config-reloader" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930195 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="prom-label-proxy" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930200 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="prom-label-proxy" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930207 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="thanos-sidecar" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930211 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="thanos-sidecar" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930220 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="config-reloader" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930226 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="config-reloader" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930274 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e167a4b7-89c4-4abe-bc0f-0c5c3e5c9f9b" containerName="registry" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930280 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="prom-label-proxy" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930286 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc4e2f51-c49b-4206-85e1-0f2e7995fcf4" containerName="console" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930291 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="thanos-sidecar" Jun 15 03:20:44.930285 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930297 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-metric" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930303 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930309 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="alertmanager" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930316 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930321 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="config-reloader" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930326 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-web" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930331 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="prometheus" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930335 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="kube-rbac-proxy-thanos" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930340 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbb8ba3-b539-43b9-9ea5-2d1c58cc510c" containerName="kube-rbac-proxy-web" Jun 15 03:20:44.931086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.930345 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" containerName="config-reloader" Jun 15 03:20:44.931961 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.931943 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.932242 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.932222 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.932316 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932249 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} err="failed to get container status \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" Jun 15 03:20:44.932316 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932265 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.932512 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.932496 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.932554 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932517 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} err="failed to get container status \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" Jun 15 03:20:44.932554 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932533 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.932726 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.932712 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.932771 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932729 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} err="failed to get container status \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" Jun 15 03:20:44.932771 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932741 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.932940 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.932919 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.933008 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932947 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} err="failed to get container status \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" Jun 15 03:20:44.933008 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.932968 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.933193 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.933177 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.933230 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.933196 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} err="failed to get container status \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" Jun 15 03:20:44.933230 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.933209 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.933794 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.933779 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.933859 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.933797 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} err="failed to get container status \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" Jun 15 03:20:44.933859 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.933811 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.933961 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.933910 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:44.934163 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:20:44.934103 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.934163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.934128 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} err="failed to get container status \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" Jun 15 03:20:44.934163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.934167 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.934710 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.934677 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} err="failed to get container status \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" Jun 15 03:20:44.934824 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.934713 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.935125 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.935072 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} err="failed to get container status \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" Jun 15 03:20:44.935125 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.935103 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.935404 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.935381 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} err="failed to get container status \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" Jun 15 03:20:44.935484 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.935407 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.937644 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.937289 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} err="failed to get container status \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" Jun 15 03:20:44.937644 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.937315 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.937887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.937820 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} err="failed to get container status \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" Jun 15 03:20:44.937887 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.937845 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.938036 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.937951 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 03:20:44.938087 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938070 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 03:20:44.938143 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938081 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dr6gj\"" Jun 15 03:20:44.938226 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938203 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 03:20:44.938280 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938245 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 03:20:44.938525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938325 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 03:20:44.938525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938331 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 03:20:44.938525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938388 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 03:20:44.938525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938410 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a49jtdoc64mpf\"" Jun 15 03:20:44.938525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938244 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 03:20:44.938785 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938530 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 03:20:44.938785 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938592 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 03:20:44.939029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938974 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 03:20:44.939029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.938982 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} err="failed to get container status \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" Jun 15 03:20:44.939029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939006 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.939029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939008 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 03:20:44.939477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939112 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 03:20:44.939477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939449 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} err="failed to get container status \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" Jun 15 03:20:44.939477 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939472 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.939773 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939747 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} err="failed to get container status \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" Jun 15 03:20:44.939904 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.939775 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.940042 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940016 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} err="failed to get container status \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" Jun 15 03:20:44.940115 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940042 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.940556 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940435 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} err="failed to get container status \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" Jun 15 03:20:44.940556 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940471 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.940708 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940689 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 03:20:44.940768 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940727 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} err="failed to get container status \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" Jun 15 03:20:44.940768 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940750 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.941019 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.940995 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} err="failed to get container status \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" Jun 15 03:20:44.941019 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941018 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.941284 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941264 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} err="failed to get container status \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" Jun 15 03:20:44.941406 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941284 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.941580 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941551 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} err="failed to get container status \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" Jun 15 03:20:44.941580 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941574 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.941971 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941942 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} err="failed to get container status \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" Jun 15 03:20:44.942071 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.941972 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.942380 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942354 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} err="failed to get container status \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" Jun 15 03:20:44.942380 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942375 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.942686 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942645 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} err="failed to get container status \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" Jun 15 03:20:44.942686 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942672 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.942976 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942952 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} err="failed to get container status \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" Jun 15 03:20:44.942976 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942976 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.943095 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.942977 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 03:20:44.943524 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.943503 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} err="failed to get container status \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" Jun 15 03:20:44.943524 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.943524 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.943770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.943750 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} err="failed to get container status \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" Jun 15 03:20:44.943851 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.943773 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.944034 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944015 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} err="failed to get container status \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" Jun 15 03:20:44.944085 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944035 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.944297 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944278 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} err="failed to get container status \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" Jun 15 03:20:44.944353 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944298 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.944531 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944516 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} err="failed to get container status \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" Jun 15 03:20:44.944586 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944531 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.944742 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944726 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} err="failed to get container status \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" Jun 15 03:20:44.944801 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944741 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.944973 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944956 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} err="failed to get container status \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" Jun 15 03:20:44.945022 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.944974 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.945226 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.945205 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} err="failed to get container status \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" Jun 15 03:20:44.945226 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.945226 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.945450 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.945432 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} err="failed to get container status \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" Jun 15 03:20:44.945504 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.945451 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.945779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.945749 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} err="failed to get container status \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" Jun 15 03:20:44.945964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.945781 2559 scope.go:117] "RemoveContainer" containerID="82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9" Jun 15 03:20:44.946046 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.946016 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9"} err="failed to get container status \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": rpc error: code = NotFound desc = could not find container \"82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9\": container with ID starting with 82d078de6ecaf9f03c43e30af297a2d18b2add177836ff3ea62a2e2769fe81b9 not found: ID does not exist" Jun 15 03:20:44.946046 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.946038 2559 scope.go:117] "RemoveContainer" containerID="3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4" Jun 15 03:20:44.946372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.946328 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4"} err="failed to get container status \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": rpc error: code = NotFound desc = could not find container \"3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4\": container with ID starting with 3943bfd056d99492655b662abab0d7e9641b21f8361591b04124d4110038b9a4 not found: ID does not exist" Jun 15 03:20:44.946372 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.946354 2559 scope.go:117] "RemoveContainer" containerID="b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9" Jun 15 03:20:44.946879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.946859 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9"} err="failed to get container status \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": rpc error: code = NotFound desc = could not find container \"b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9\": container with ID starting with b3a822a40430921b1008e7c712a0d4887da3fcb5aa1d2451b657a0af86889cc9 not found: ID does not exist" Jun 15 03:20:44.946943 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.946881 2559 scope.go:117] "RemoveContainer" containerID="26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646" Jun 15 03:20:44.947164 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947130 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646"} err="failed to get container status \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": rpc error: code = NotFound desc = could not find container \"26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646\": container with ID starting with 26523323ee3b4c4caeef8d50cda56102c35db746bb61b7b77e02d756187c7646 not found: ID does not exist" Jun 15 03:20:44.947249 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947166 2559 scope.go:117] "RemoveContainer" containerID="1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe" Jun 15 03:20:44.947444 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947424 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe"} err="failed to get container status \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": rpc error: code = NotFound desc = could not find container \"1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe\": container with ID starting with 1c81ca916b069f2c7993fb6fca2c4417d8e4b374dd76ef11bbe73105fcb807fe not found: ID does not exist" Jun 15 03:20:44.947520 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947445 2559 scope.go:117] "RemoveContainer" containerID="6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb" Jun 15 03:20:44.947694 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947671 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb"} err="failed to get container status \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": rpc error: code = NotFound desc = could not find container \"6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb\": container with ID starting with 6acbb3966bbb36fafcd965257819f487ae116be2369026aca7a77290e1698dcb not found: ID does not exist" Jun 15 03:20:44.947694 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947689 2559 scope.go:117] "RemoveContainer" containerID="34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885" Jun 15 03:20:44.947954 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.947935 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885"} err="failed to get container status \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": rpc error: code = NotFound desc = could not find container \"34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885\": container with ID starting with 34aa3518bafb426910dcec3157144ea47f9096507f9c1d8d3bbd4df98e583885 not found: ID does not exist" Jun 15 03:20:44.948264 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:44.948247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:20:45.046012 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.045985 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="997e3a51-357b-42e1-98f4-09df69b65df4" path="/var/lib/kubelet/pods/997e3a51-357b-42e1-98f4-09df69b65df4/volumes" Jun 15 03:20:45.121569 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51810a20-6027-40a1-be99-fca68667f710-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nldrq\" (UniqueName: \"kubernetes.io/projected/51810a20-6027-40a1-be99-fca68667f710-kube-api-access-nldrq\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51810a20-6027-40a1-be99-fca68667f710-config-out\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.121879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-config\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.121991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.122320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.122217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-web-config\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223207 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51810a20-6027-40a1-be99-fca68667f710-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nldrq\" (UniqueName: \"kubernetes.io/projected/51810a20-6027-40a1-be99-fca68667f710-kube-api-access-nldrq\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51810a20-6027-40a1-be99-fca68667f710-config-out\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-config\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.223595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224018 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.223732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-web-config\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.224353 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.224190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.226446 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.226365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.226446 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.226365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.226446 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.226412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.226446 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.226426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-web-config\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.226718 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.226478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51810a20-6027-40a1-be99-fca68667f710-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227110 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227226 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227345 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227262 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227925 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227925 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227925 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.227925 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.227887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.228790 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.228754 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.228935 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.228917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-config\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.229252 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.229233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51810a20-6027-40a1-be99-fca68667f710-config-out\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.229458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.229441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51810a20-6027-40a1-be99-fca68667f710-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.230387 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.230368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51810a20-6027-40a1-be99-fca68667f710-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.232426 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.232407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nldrq\" (UniqueName: \"kubernetes.io/projected/51810a20-6027-40a1-be99-fca68667f710-kube-api-access-nldrq\") pod \"prometheus-k8s-0\" (UID: \"51810a20-6027-40a1-be99-fca68667f710\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.246222 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.246204 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:45.378220 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.378108 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 03:20:45.380371 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:20:45.380345 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51810a20_6027_40a1_be99_fca68667f710.slice/crio-2743d8f5eee2276341ae711a318a9e4becf552caf2184b7b3fbd326f105d1d31 WatchSource:0}: Error finding container 2743d8f5eee2276341ae711a318a9e4becf552caf2184b7b3fbd326f105d1d31: Status 404 returned error can't find the container with id 2743d8f5eee2276341ae711a318a9e4becf552caf2184b7b3fbd326f105d1d31 Jun 15 03:20:45.883879 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.883843 2559 generic.go:356] "Generic (PLEG): container finished" podID="51810a20-6027-40a1-be99-fca68667f710" containerID="2c0edf1689edcc620daf075485020d30d6fd3fd610c69fd4269a1106e3f2fce6" exitCode=0 Jun 15 03:20:45.884049 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.883913 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerDied","Data":"2c0edf1689edcc620daf075485020d30d6fd3fd610c69fd4269a1106e3f2fce6"} Jun 15 03:20:45.884049 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:45.883966 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"2743d8f5eee2276341ae711a318a9e4becf552caf2184b7b3fbd326f105d1d31"} Jun 15 03:20:46.892939 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.892899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"68149d4ef16e51e3f7a1c8bce419cd7d5452b695796e3189aad3838d09853944"} Jun 15 03:20:46.893325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.893021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"ee62f148a80fa3d1263f2b44141928bf846fe8b7d27336070eb88ed8483de76c"} Jun 15 03:20:46.893325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.893074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"d4b5d7ba83b3d0a933e835de95d1b0223fa06ca85b9956c01e39df0b53fefb58"} Jun 15 03:20:46.893325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.893113 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"049fefd99ee979402ebfefa6473c895aa11465f456997e651022e5177c4148a3"} Jun 15 03:20:46.893325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.893169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"edd8d36cabbcc61ac00b87c05c02354fd8c5d2c4ba5c97c8c573c88446e2fce3"} Jun 15 03:20:46.893325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.893206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51810a20-6027-40a1-be99-fca68667f710","Type":"ContainerStarted","Data":"b3fc63fcd8223d3cfa5b2e7c9409b55140c1ac7fff4ae6e09cc597218ef4252f"} Jun 15 03:20:46.924882 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:46.924834 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.906521231 podStartE2EDuration="2.924819273s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.298042ms" isStatefulPod=false podCreationTimestamp="2026-06-15 03:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:20:46.921866542 +0000 UTC m=+166.366061277" watchObservedRunningTime="2026-06-15 03:20:46.924819273 +0000 UTC m=+166.369013979" Jun 15 03:20:47.896227 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:47.896194 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:47.990369 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:47.990306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:48.090629 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:48.090598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:48.608562 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:48.608526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:48.660769 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:48.660741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:50.247394 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:50.247347 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:20:59.099409 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:59.099375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:59.151238 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:59.151204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:20:59.202404 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:20:59.202377 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:21:20.379167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:20.379119 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:21:20.425778 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:20.425753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:21:45.247086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:45.247050 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:21:45.262233 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:45.262205 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:21:46.141833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:46.141797 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 03:21:53.964563 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:53.964523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:21:54.021112 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:21:54.021083 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:01.868079 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:01.868041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:01.921307 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:01.921281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:05.806334 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:05.806299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:05.860124 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:05.860096 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:12.391518 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:12.391483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:12.440256 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:12.440229 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:12.495990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:12.495959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:13.021971 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:13.021941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:13.120333 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:13.120309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:13.331971 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:13.331881 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:13.382664 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:13.382642 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:41.243448 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:41.243414 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:22:41.375518 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:22:41.375490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:00.995101 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:00.995070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:23:00.999858 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:00.999835 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 03:23:01.002677 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:01.002660 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:23:02.738366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:02.738337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:03.825006 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:03.824976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:06.351324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:06.351294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:06.451817 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:06.451785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:07.908661 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:07.908631 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:08.007411 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:08.007378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:08.108529 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:08.108504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:11.367002 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:11.366965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:11.746232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:11.746198 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:13.150473 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:13.150438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:13.216521 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:13.216488 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:18.961573 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:18.961540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:19.161636 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:19.161599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:19.265188 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:19.265098 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:25.393943 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:25.393908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:25.494767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:25.494737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:27.083162 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:27.083114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:35.357987 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:35.357952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:35.408166 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:35.408109 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:39.949877 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:39.949843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:40.047681 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.047652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:40.575759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.575728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:40.771497 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.771460 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:40.869014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.868948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:40.912022 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.911992 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd"] Jun 15 03:23:40.915595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.915573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:40.918218 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.918194 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 03:23:40.918346 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.918281 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 03:23:40.918418 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.918370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rqg7g\"" Jun 15 03:23:40.918475 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.918460 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 03:23:40.918529 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.918493 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 03:23:40.939015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.938958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd"] Jun 15 03:23:40.986485 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.986455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/414c4dc1-abf5-495d-90cd-6bbb6501501c-manifests\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:40.986485 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.986485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/414c4dc1-abf5-495d-90cd-6bbb6501501c-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:40.986937 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.986515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/414c4dc1-abf5-495d-90cd-6bbb6501501c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:40.986937 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.986614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lfb9\" (UniqueName: \"kubernetes.io/projected/414c4dc1-abf5-495d-90cd-6bbb6501501c-kube-api-access-8lfb9\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:40.986937 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:40.986709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414c4dc1-abf5-495d-90cd-6bbb6501501c-tmp\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.081338 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.081307 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:41.087279 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.087252 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/414c4dc1-abf5-495d-90cd-6bbb6501501c-manifests\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.087427 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.087283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/414c4dc1-abf5-495d-90cd-6bbb6501501c-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.087427 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.087345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/414c4dc1-abf5-495d-90cd-6bbb6501501c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.087427 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.087392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lfb9\" (UniqueName: \"kubernetes.io/projected/414c4dc1-abf5-495d-90cd-6bbb6501501c-kube-api-access-8lfb9\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.087427 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.087418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414c4dc1-abf5-495d-90cd-6bbb6501501c-tmp\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.087730 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.087681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/414c4dc1-abf5-495d-90cd-6bbb6501501c-manifests\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.090232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.090202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414c4dc1-abf5-495d-90cd-6bbb6501501c-tmp\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.090232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.090220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/414c4dc1-abf5-495d-90cd-6bbb6501501c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.090385 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.090240 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/414c4dc1-abf5-495d-90cd-6bbb6501501c-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.096297 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.096271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lfb9\" (UniqueName: \"kubernetes.io/projected/414c4dc1-abf5-495d-90cd-6bbb6501501c-kube-api-access-8lfb9\") pod \"opendatahub-operator-controller-manager-68fc7565bc-lr2bd\" (UID: \"414c4dc1-abf5-495d-90cd-6bbb6501501c\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.181729 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.181702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:41.227042 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.227021 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:41.282118 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.282093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:41.362662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.362619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd"] Jun 15 03:23:41.366037 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.365993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:41.367092 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:23:41.367072 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414c4dc1_abf5_495d_90cd_6bbb6501501c.slice/crio-fcd05ff3d601a41fadde3e25da89d622dbab676df5d4aedf626577eeb2740f74 WatchSource:0}: Error finding container fcd05ff3d601a41fadde3e25da89d622dbab676df5d4aedf626577eeb2740f74: Status 404 returned error can't find the container with id fcd05ff3d601a41fadde3e25da89d622dbab676df5d4aedf626577eeb2740f74 Jun 15 03:23:41.368842 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.368826 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:23:41.427678 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.427653 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:41.531660 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.531606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:41.551888 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.551866 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" event={"ID":"414c4dc1-abf5-495d-90cd-6bbb6501501c","Type":"ContainerStarted","Data":"fcd05ff3d601a41fadde3e25da89d622dbab676df5d4aedf626577eeb2740f74"} Jun 15 03:23:41.629881 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:41.629862 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:44.568100 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:44.568067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" event={"ID":"414c4dc1-abf5-495d-90cd-6bbb6501501c","Type":"ContainerStarted","Data":"5b7df8cba24368a50e610ff913c0e3c056466971abf16dcc80fd51b78093289e"} Jun 15 03:23:45.574450 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:45.574417 2559 generic.go:356] "Generic (PLEG): container finished" podID="414c4dc1-abf5-495d-90cd-6bbb6501501c" containerID="5b7df8cba24368a50e610ff913c0e3c056466971abf16dcc80fd51b78093289e" exitCode=0 Jun 15 03:23:45.574862 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:45.574508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" event={"ID":"414c4dc1-abf5-495d-90cd-6bbb6501501c","Type":"ContainerDied","Data":"5b7df8cba24368a50e610ff913c0e3c056466971abf16dcc80fd51b78093289e"} Jun 15 03:23:46.581706 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:46.581670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" event={"ID":"414c4dc1-abf5-495d-90cd-6bbb6501501c","Type":"ContainerStarted","Data":"643fb0e90960fe3c02df552a523641fb58bfad2853c0dca2c218a609f00ef48c"} Jun 15 03:23:46.582120 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:46.581781 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:46.602947 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:46.602892 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" podStartSLOduration=2.366284272 podStartE2EDuration="6.602874443s" totalImagesPullingTime="3.2692073s" totalInitContainerRuntime="967.382871ms" isStatefulPod=false podCreationTimestamp="2026-06-15 03:23:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:23:46.602482703 +0000 UTC m=+346.046677411" watchObservedRunningTime="2026-06-15 03:23:46.602874443 +0000 UTC m=+346.047069152" Jun 15 03:23:51.516009 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:51.515972 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:51.609422 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:51.609383 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:57.587753 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:57.587723 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-lr2bd" Jun 15 03:23:59.272460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:59.272430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:59.399786 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:59.399753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:59.542254 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:59.542172 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:59.670599 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:59.670556 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:23:59.849690 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:23:59.849600 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:00.009665 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:00.009632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:00.104461 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:00.104379 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:00.204402 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:00.204369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:00.724317 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:00.724282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:00.960557 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:00.960521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:01.819297 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.819268 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:01.921979 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.921945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:01.946634 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.946596 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq"] Jun 15 03:24:01.958327 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.958298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:01.961899 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.961841 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 03:24:01.962926 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.962904 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 03:24:01.963521 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.963504 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 03:24:01.963836 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.963818 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j7d7f\"" Jun 15 03:24:01.964129 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.964112 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 03:24:01.964538 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.964517 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:24:01.969302 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:01.969226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq"] Jun 15 03:24:02.043365 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.043328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39e54551-f37c-46ec-969f-d2de3c80b258-manager-config\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.043541 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.043387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39e54551-f37c-46ec-969f-d2de3c80b258-metrics-cert\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.043541 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.043455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e54551-f37c-46ec-969f-d2de3c80b258-cert\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.043541 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.043513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjtgk\" (UniqueName: \"kubernetes.io/projected/39e54551-f37c-46ec-969f-d2de3c80b258-kube-api-access-wjtgk\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.144471 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.144436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39e54551-f37c-46ec-969f-d2de3c80b258-manager-config\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.144668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.144490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39e54551-f37c-46ec-969f-d2de3c80b258-metrics-cert\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.144668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.144516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e54551-f37c-46ec-969f-d2de3c80b258-cert\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.144668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.144553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjtgk\" (UniqueName: \"kubernetes.io/projected/39e54551-f37c-46ec-969f-d2de3c80b258-kube-api-access-wjtgk\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.145249 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.145209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39e54551-f37c-46ec-969f-d2de3c80b258-manager-config\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.147733 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.147707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e54551-f37c-46ec-969f-d2de3c80b258-cert\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.147855 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.147707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39e54551-f37c-46ec-969f-d2de3c80b258-metrics-cert\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.154197 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.154134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjtgk\" (UniqueName: \"kubernetes.io/projected/39e54551-f37c-46ec-969f-d2de3c80b258-kube-api-access-wjtgk\") pod \"lws-controller-manager-94db46dd7-hqdwq\" (UID: \"39e54551-f37c-46ec-969f-d2de3c80b258\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.273475 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.273448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:02.405872 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.405844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq"] Jun 15 03:24:02.408501 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:24:02.408472 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e54551_f37c_46ec_969f_d2de3c80b258.slice/crio-f9163520a65ec2862a0ed5cae29607a826b75fcc1855dbfd6564b2f316596fb9 WatchSource:0}: Error finding container f9163520a65ec2862a0ed5cae29607a826b75fcc1855dbfd6564b2f316596fb9: Status 404 returned error can't find the container with id f9163520a65ec2862a0ed5cae29607a826b75fcc1855dbfd6564b2f316596fb9 Jun 15 03:24:02.651758 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:02.651712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" event={"ID":"39e54551-f37c-46ec-969f-d2de3c80b258","Type":"ContainerStarted","Data":"f9163520a65ec2862a0ed5cae29607a826b75fcc1855dbfd6564b2f316596fb9"} Jun 15 03:24:05.668522 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:05.668470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" event={"ID":"39e54551-f37c-46ec-969f-d2de3c80b258","Type":"ContainerStarted","Data":"4d0f6c17b23c0ec247609319cfe2f3c1d35acb1262d6d73040106deb064dfee0"} Jun 15 03:24:05.668919 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:05.668557 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:05.684091 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:05.684034 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" podStartSLOduration=2.182449516 podStartE2EDuration="4.684018529s" totalImagesPullingTime="2.501569013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:24:05.683571357 +0000 UTC m=+365.127766064" watchObservedRunningTime="2026-06-15 03:24:05.684018529 +0000 UTC m=+365.128213236" Jun 15 03:24:10.007507 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:10.007478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:10.119248 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:10.119210 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:10.410805 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:10.410771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:10.501836 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:10.501800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:11.340074 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:11.340029 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:11.437811 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:11.437786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:16.676109 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:16.676082 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-hqdwq" Jun 15 03:24:20.286052 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:20.286021 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:20.399365 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:20.399316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:21.598706 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:21.598668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:21.695756 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:21.695716 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:22.499095 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:22.499064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:22.610681 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:22.610640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:24.310262 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:24.310230 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:29.978665 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:29.978622 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7dfff65d9-9ttgk"] Jun 15 03:24:29.982020 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:29.981997 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:29.984587 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:29.984567 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 03:24:29.984704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:29.984570 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7f4gv\"" Jun 15 03:24:29.990132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:29.990031 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7dfff65d9-9ttgk"] Jun 15 03:24:29.993311 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:29.993249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:30.081090 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.081062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgj5p\" (UniqueName: \"kubernetes.io/projected/ca47a677-e807-4b60-8088-b554ceaff616-kube-api-access-lgj5p\") pod \"dashboard-redirect-7dfff65d9-9ttgk\" (UID: \"ca47a677-e807-4b60-8088-b554ceaff616\") " pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.081250 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.081103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca47a677-e807-4b60-8088-b554ceaff616-redirect-config\") pod \"dashboard-redirect-7dfff65d9-9ttgk\" (UID: \"ca47a677-e807-4b60-8088-b554ceaff616\") " pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.182620 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.182579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgj5p\" (UniqueName: \"kubernetes.io/projected/ca47a677-e807-4b60-8088-b554ceaff616-kube-api-access-lgj5p\") pod \"dashboard-redirect-7dfff65d9-9ttgk\" (UID: \"ca47a677-e807-4b60-8088-b554ceaff616\") " pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.182960 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.182927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca47a677-e807-4b60-8088-b554ceaff616-redirect-config\") pod \"dashboard-redirect-7dfff65d9-9ttgk\" (UID: \"ca47a677-e807-4b60-8088-b554ceaff616\") " pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.183775 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.183747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca47a677-e807-4b60-8088-b554ceaff616-redirect-config\") pod \"dashboard-redirect-7dfff65d9-9ttgk\" (UID: \"ca47a677-e807-4b60-8088-b554ceaff616\") " pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.191569 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.191541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgj5p\" (UniqueName: \"kubernetes.io/projected/ca47a677-e807-4b60-8088-b554ceaff616-kube-api-access-lgj5p\") pod \"dashboard-redirect-7dfff65d9-9ttgk\" (UID: \"ca47a677-e807-4b60-8088-b554ceaff616\") " pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.293735 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.293670 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" Jun 15 03:24:30.420424 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.420400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7dfff65d9-9ttgk"] Jun 15 03:24:30.422727 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:24:30.422698 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca47a677_e807_4b60_8088_b554ceaff616.slice/crio-d8c843b96365985eea0781ae0f23ce31766b48b4deb6e676fc691164588ecc1c WatchSource:0}: Error finding container d8c843b96365985eea0781ae0f23ce31766b48b4deb6e676fc691164588ecc1c: Status 404 returned error can't find the container with id d8c843b96365985eea0781ae0f23ce31766b48b4deb6e676fc691164588ecc1c Jun 15 03:24:30.772103 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:30.772070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" event={"ID":"ca47a677-e807-4b60-8088-b554ceaff616","Type":"ContainerStarted","Data":"d8c843b96365985eea0781ae0f23ce31766b48b4deb6e676fc691164588ecc1c"} Jun 15 03:24:32.784307 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:32.784229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" event={"ID":"ca47a677-e807-4b60-8088-b554ceaff616","Type":"ContainerStarted","Data":"d100df7f2196fda00794915ae9bb41d6fd4224bef328a02fde161a1ddd7ac5ab"} Jun 15 03:24:32.801604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:32.801540 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7dfff65d9-9ttgk" podStartSLOduration=1.838453344 podStartE2EDuration="3.801522608s" totalImagesPullingTime="1.963069264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:24:32.801446962 +0000 UTC m=+392.245641667" watchObservedRunningTime="2026-06-15 03:24:32.801522608 +0000 UTC m=+392.245717315" Jun 15 03:24:34.853653 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:34.853623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:34.953913 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:34.953888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:52.729386 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:52.729353 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:52.783976 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:52.783949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:54.199476 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:54.199445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:54.297536 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:54.297508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:54.723527 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:54.723474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:54.877436 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:54.877405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:57.619202 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.619143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:57.719642 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.719609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:57.884966 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.884939 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp"] Jun 15 03:24:57.888366 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.888348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.891013 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.890990 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 03:24:57.891141 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.890991 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 03:24:57.891141 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.890991 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6ndcd\"" Jun 15 03:24:57.891141 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.891114 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 03:24:57.898684 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.898658 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp"] Jun 15 03:24:57.910323 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.910296 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:57.995413 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995508 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995508 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995508 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab2985ac-6336-4619-9def-5a31551bb4ed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995609 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995609 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995676 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995709 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4nrh\" (UniqueName: \"kubernetes.io/projected/ab2985ac-6336-4619-9def-5a31551bb4ed-kube-api-access-c4nrh\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:57.995743 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:57.995717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.096600 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.096784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.096784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.096784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.096784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab2985ac-6336-4619-9def-5a31551bb4ed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.096784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097060 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097060 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.096973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097060 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.097049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4nrh\" (UniqueName: \"kubernetes.io/projected/ab2985ac-6336-4619-9def-5a31551bb4ed-kube-api-access-c4nrh\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097242 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.097076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097455 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.097427 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097574 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.097434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.097574 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.097554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.098029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.098006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab2985ac-6336-4619-9def-5a31551bb4ed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.099113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.099094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.099340 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.099323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.109774 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.109749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab2985ac-6336-4619-9def-5a31551bb4ed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.109990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.109969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4nrh\" (UniqueName: \"kubernetes.io/projected/ab2985ac-6336-4619-9def-5a31551bb4ed-kube-api-access-c4nrh\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gd7zp\" (UID: \"ab2985ac-6336-4619-9def-5a31551bb4ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.118607 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.118586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:58.200689 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.200629 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:24:58.215868 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.215842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:58.343331 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.343309 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp"] Jun 15 03:24:58.345478 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:24:58.345449 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2985ac_6336_4619_9def_5a31551bb4ed.slice/crio-639869eeb15bb7600cc63663ef635fa7d534c3af3aff1d704e439282f048c9df WatchSource:0}: Error finding container 639869eeb15bb7600cc63663ef635fa7d534c3af3aff1d704e439282f048c9df: Status 404 returned error can't find the container with id 639869eeb15bb7600cc63663ef635fa7d534c3af3aff1d704e439282f048c9df Jun 15 03:24:58.364169 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.364110 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:24:58.896055 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:24:58.896020 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" event={"ID":"ab2985ac-6336-4619-9def-5a31551bb4ed","Type":"ContainerStarted","Data":"639869eeb15bb7600cc63663ef635fa7d534c3af3aff1d704e439282f048c9df"} Jun 15 03:25:00.860335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.860279 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:00.960235 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.960206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:00.973537 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.973500 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:25:00.973666 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.973582 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:25:00.973666 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.973624 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:25:00.984933 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.984911 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bfxtx"] Jun 15 03:25:00.988495 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.988476 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:00.991871 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.991848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 03:25:00.992654 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.992622 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x8pxw\"" Jun 15 03:25:00.992955 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:00.992625 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 03:25:01.006765 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.006741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bfxtx"] Jun 15 03:25:01.021830 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.021806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cww46\" (UniqueName: \"kubernetes.io/projected/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e-kube-api-access-cww46\") pod \"kuadrant-operator-catalog-bfxtx\" (UID: \"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e\") " pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:01.037328 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.037289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:01.123238 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.123128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cww46\" (UniqueName: \"kubernetes.io/projected/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e-kube-api-access-cww46\") pod \"kuadrant-operator-catalog-bfxtx\" (UID: \"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e\") " pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:01.132665 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.132637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cww46\" (UniqueName: \"kubernetes.io/projected/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e-kube-api-access-cww46\") pod \"kuadrant-operator-catalog-bfxtx\" (UID: \"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e\") " pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:01.317496 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.317466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:01.352993 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.352960 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bfxtx"] Jun 15 03:25:01.453471 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.453438 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bfxtx"] Jun 15 03:25:01.456127 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:25:01.456098 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e5bd48_eb0c_41a3_8ffa_831e3c12803e.slice/crio-e9ede49c52d26d2e57f577457d4c04571f59de741c9d457082f979d167d1fa3c WatchSource:0}: Error finding container e9ede49c52d26d2e57f577457d4c04571f59de741c9d457082f979d167d1fa3c: Status 404 returned error can't find the container with id e9ede49c52d26d2e57f577457d4c04571f59de741c9d457082f979d167d1fa3c Jun 15 03:25:01.784706 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.784627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:01.909884 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.909844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" event={"ID":"ab2985ac-6336-4619-9def-5a31551bb4ed","Type":"ContainerStarted","Data":"8038ccab8768d2e0ee4e1ff57e87adffd8288b345c2557528058ef0b07495b82"} Jun 15 03:25:01.911064 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.911037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" event={"ID":"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e","Type":"ContainerStarted","Data":"e9ede49c52d26d2e57f577457d4c04571f59de741c9d457082f979d167d1fa3c"} Jun 15 03:25:01.931639 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.931592 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" podStartSLOduration=2.30578544 podStartE2EDuration="4.931578158s" totalImagesPullingTime="2.625792718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:25:01.929890103 +0000 UTC m=+421.374084835" watchObservedRunningTime="2026-06-15 03:25:01.931578158 +0000 UTC m=+421.375772863" Jun 15 03:25:01.989530 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:01.989506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:02.201800 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:02.201767 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:25:02.206912 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:02.206888 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:25:02.918767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:02.918731 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:25:02.919891 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:02.919866 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gd7zp" Jun 15 03:25:03.927593 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:03.927558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" event={"ID":"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e","Type":"ContainerStarted","Data":"bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8"} Jun 15 03:25:03.928109 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:03.927638 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" podUID="b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" containerName="registry-server" containerID="cri-o://bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8" gracePeriod=2 Jun 15 03:25:03.944853 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:03.944806 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" podStartSLOduration=1.909284543 podStartE2EDuration="3.944790836s" totalImagesPullingTime="2.035506293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:25:03.94299417 +0000 UTC m=+423.387188878" watchObservedRunningTime="2026-06-15 03:25:03.944790836 +0000 UTC m=+423.388985541" Jun 15 03:25:04.171607 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.171581 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:04.251073 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.251002 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cww46\" (UniqueName: \"kubernetes.io/projected/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e-kube-api-access-cww46\") pod \"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e\" (UID: \"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e\") " Jun 15 03:25:04.253049 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.253022 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e-kube-api-access-cww46" (OuterVolumeSpecName: "kube-api-access-cww46") pod "b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" (UID: "b3e5bd48-eb0c-41a3-8ffa-831e3c12803e"). InnerVolumeSpecName "kube-api-access-cww46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:25:04.352445 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.352412 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cww46\" (UniqueName: \"kubernetes.io/projected/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e-kube-api-access-cww46\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:25:04.933325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.933289 2559 generic.go:356] "Generic (PLEG): container finished" podID="b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" containerID="bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8" exitCode=0 Jun 15 03:25:04.933803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.933330 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" Jun 15 03:25:04.933803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.933373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" event={"ID":"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e","Type":"ContainerDied","Data":"bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8"} Jun 15 03:25:04.933803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.933430 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bfxtx" event={"ID":"b3e5bd48-eb0c-41a3-8ffa-831e3c12803e","Type":"ContainerDied","Data":"e9ede49c52d26d2e57f577457d4c04571f59de741c9d457082f979d167d1fa3c"} Jun 15 03:25:04.933803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.933532 2559 scope.go:117] "RemoveContainer" containerID="bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8" Jun 15 03:25:04.943127 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.943106 2559 scope.go:117] "RemoveContainer" containerID="bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8" Jun 15 03:25:04.943397 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:25:04.943379 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8\": container with ID starting with bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8 not found: ID does not exist" containerID="bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8" Jun 15 03:25:04.943451 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.943404 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8"} err="failed to get container status \"bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8\": rpc error: code = NotFound desc = could not find container \"bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8\": container with ID starting with bc139df945b8747cff8c83b55820ebd261c001ed6c51b9fabc1acf225e7600a8 not found: ID does not exist" Jun 15 03:25:04.955294 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.955273 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bfxtx"] Jun 15 03:25:04.958763 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:04.958744 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bfxtx"] Jun 15 03:25:05.046814 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:05.046787 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" path="/var/lib/kubelet/pods/b3e5bd48-eb0c-41a3-8ffa-831e3c12803e/volumes" Jun 15 03:25:28.641954 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:28.641878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:30.321367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:30.321335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:32.978354 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:32.978318 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9"] Jun 15 03:25:32.978815 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:32.978798 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" containerName="registry-server" Jun 15 03:25:32.978892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:32.978819 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" containerName="registry-server" Jun 15 03:25:32.978952 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:32.978919 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3e5bd48-eb0c-41a3-8ffa-831e3c12803e" containerName="registry-server" Jun 15 03:25:32.988769 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:32.988745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:32.998466 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:32.998447 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 03:25:33.001121 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.001095 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 03:25:33.002229 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.002209 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tllmh\"" Jun 15 03:25:33.003803 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.003781 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9"] Jun 15 03:25:33.068717 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.068689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2669k\" (UniqueName: \"kubernetes.io/projected/99344b7c-8a86-43cf-addd-463bfd0a6bfb-kube-api-access-2669k\") pod \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" (UID: \"99344b7c-8a86-43cf-addd-463bfd0a6bfb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:33.170009 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.169985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2669k\" (UniqueName: \"kubernetes.io/projected/99344b7c-8a86-43cf-addd-463bfd0a6bfb-kube-api-access-2669k\") pod \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" (UID: \"99344b7c-8a86-43cf-addd-463bfd0a6bfb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:33.180922 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.180902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2669k\" (UniqueName: \"kubernetes.io/projected/99344b7c-8a86-43cf-addd-463bfd0a6bfb-kube-api-access-2669k\") pod \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" (UID: \"99344b7c-8a86-43cf-addd-463bfd0a6bfb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:33.298015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.297947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:33.428121 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.428098 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9"] Jun 15 03:25:33.430945 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:25:33.430917 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99344b7c_8a86_43cf_addd_463bfd0a6bfb.slice/crio-716ffa0bed69a1b3060ec002e7de187942f489b5e2905dadb03e268929263c8a WatchSource:0}: Error finding container 716ffa0bed69a1b3060ec002e7de187942f489b5e2905dadb03e268929263c8a: Status 404 returned error can't find the container with id 716ffa0bed69a1b3060ec002e7de187942f489b5e2905dadb03e268929263c8a Jun 15 03:25:33.923865 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:33.923837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:34.023580 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:34.023554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:34.058227 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:34.058193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" event={"ID":"99344b7c-8a86-43cf-addd-463bfd0a6bfb","Type":"ContainerStarted","Data":"716ffa0bed69a1b3060ec002e7de187942f489b5e2905dadb03e268929263c8a"} Jun 15 03:25:36.071217 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:36.071176 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" event={"ID":"99344b7c-8a86-43cf-addd-463bfd0a6bfb","Type":"ContainerStarted","Data":"e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c"} Jun 15 03:25:36.071647 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:36.071355 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:36.092777 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:36.092732 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" podStartSLOduration=2.113666832 podStartE2EDuration="4.092718831s" totalImagesPullingTime="1.979051999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:25:36.091231412 +0000 UTC m=+455.535426118" watchObservedRunningTime="2026-06-15 03:25:36.092718831 +0000 UTC m=+455.536913536" Jun 15 03:25:38.943644 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:38.943608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:39.254711 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:39.254629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:40.875950 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:40.875914 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd"] Jun 15 03:25:40.883498 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:40.883479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:40.885846 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:40.885826 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 03:25:40.885846 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:40.885838 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m6lhz\"" Jun 15 03:25:40.889183 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:40.889162 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd"] Jun 15 03:25:41.040724 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.040688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hs28\" (UniqueName: \"kubernetes.io/projected/3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4-kube-api-access-5hs28\") pod \"dns-operator-controller-manager-864dd78c4c-bwwpd\" (UID: \"3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:41.141977 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.141950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hs28\" (UniqueName: \"kubernetes.io/projected/3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4-kube-api-access-5hs28\") pod \"dns-operator-controller-manager-864dd78c4c-bwwpd\" (UID: \"3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:41.161349 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.161323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hs28\" (UniqueName: \"kubernetes.io/projected/3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4-kube-api-access-5hs28\") pod \"dns-operator-controller-manager-864dd78c4c-bwwpd\" (UID: \"3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:41.194289 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.194264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:41.312594 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.312558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:41.330408 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.330385 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd"] Jun 15 03:25:41.333050 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:25:41.333026 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3796fc2f_4a09_4a8a_b1e3_aee6301eaeb4.slice/crio-1d3d7143287c61200fbeff3bc32f16238cfea1ef482539987b42006d578a05bb WatchSource:0}: Error finding container 1d3d7143287c61200fbeff3bc32f16238cfea1ef482539987b42006d578a05bb: Status 404 returned error can't find the container with id 1d3d7143287c61200fbeff3bc32f16238cfea1ef482539987b42006d578a05bb Jun 15 03:25:41.579948 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.579870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:41.719964 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:41.719924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:42.097935 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:42.097883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" event={"ID":"3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4","Type":"ContainerStarted","Data":"1d3d7143287c61200fbeff3bc32f16238cfea1ef482539987b42006d578a05bb"} Jun 15 03:25:43.968610 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:43.968544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:44.066055 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.066020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:44.111335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.111303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" event={"ID":"3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4","Type":"ContainerStarted","Data":"b22e661eda12f8f15903a880b66f1dce532b4265331954758d89ce6f6d59ce51"} Jun 15 03:25:44.111494 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.111404 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:44.134662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.134603 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" podStartSLOduration=2.021809935 podStartE2EDuration="4.13458727s" totalImagesPullingTime="2.112777335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:25:44.132807037 +0000 UTC m=+463.577001745" watchObservedRunningTime="2026-06-15 03:25:44.13458727 +0000 UTC m=+463.578781976" Jun 15 03:25:44.427916 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.427885 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6"] Jun 15 03:25:44.431096 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.431082 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:44.433622 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.433601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-btn9t\"" Jun 15 03:25:44.441750 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.441730 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6"] Jun 15 03:25:44.467746 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.467720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzjh\" (UniqueName: \"kubernetes.io/projected/8531f966-9bc8-44df-8fbb-695cd5145058-kube-api-access-6qzjh\") pod \"authorino-operator-75cc8d5cb7-t8wj6\" (UID: \"8531f966-9bc8-44df-8fbb-695cd5145058\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:44.568157 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.568130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzjh\" (UniqueName: \"kubernetes.io/projected/8531f966-9bc8-44df-8fbb-695cd5145058-kube-api-access-6qzjh\") pod \"authorino-operator-75cc8d5cb7-t8wj6\" (UID: \"8531f966-9bc8-44df-8fbb-695cd5145058\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:44.577804 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.577787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzjh\" (UniqueName: \"kubernetes.io/projected/8531f966-9bc8-44df-8fbb-695cd5145058-kube-api-access-6qzjh\") pod \"authorino-operator-75cc8d5cb7-t8wj6\" (UID: \"8531f966-9bc8-44df-8fbb-695cd5145058\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:44.741451 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.741394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:44.868292 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:44.868269 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6"] Jun 15 03:25:44.870007 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:25:44.869980 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8531f966_9bc8_44df_8fbb_695cd5145058.slice/crio-f70d621e288cf19fefe776f0c5897ec052312bf18935b5212df52cf37fe256b5 WatchSource:0}: Error finding container f70d621e288cf19fefe776f0c5897ec052312bf18935b5212df52cf37fe256b5: Status 404 returned error can't find the container with id f70d621e288cf19fefe776f0c5897ec052312bf18935b5212df52cf37fe256b5 Jun 15 03:25:45.117167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:45.117066 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" event={"ID":"8531f966-9bc8-44df-8fbb-695cd5145058","Type":"ContainerStarted","Data":"f70d621e288cf19fefe776f0c5897ec052312bf18935b5212df52cf37fe256b5"} Jun 15 03:25:45.936076 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:45.936018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:46.035646 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:46.035608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:47.077698 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:47.077669 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:47.128165 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:47.128122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" event={"ID":"8531f966-9bc8-44df-8fbb-695cd5145058","Type":"ContainerStarted","Data":"40fd69f5dd0288ea0eaba0f41ee5c4c21d8df47ba0dc24d121fa82d2fe928216"} Jun 15 03:25:47.128271 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:47.128197 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:47.156948 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:47.156900 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" podStartSLOduration=0.9754366 podStartE2EDuration="3.156882302s" totalImagesPullingTime="2.181445702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:25:47.155174889 +0000 UTC m=+466.599369623" watchObservedRunningTime="2026-06-15 03:25:47.156882302 +0000 UTC m=+466.601077006" Jun 15 03:25:48.680532 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:48.680501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:49.000218 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.000136 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:49.734749 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.734714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:49.796353 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.796323 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6775f5b-xrtmh"] Jun 15 03:25:49.800133 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.800116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.802860 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.802829 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 03:25:49.802980 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.802921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 03:25:49.804046 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.804022 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-snt88\"" Jun 15 03:25:49.804210 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.804134 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 03:25:49.804288 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.804248 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 03:25:49.804467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.804449 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 03:25:49.807859 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.807837 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 03:25:49.809991 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.809971 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-trusted-ca-bundle\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.810070 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.810012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-service-ca\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.810070 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.810055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b7629f-b7f9-4165-9db1-af1b16e67194-console-serving-cert\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.810167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.810090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xxqf\" (UniqueName: \"kubernetes.io/projected/85b7629f-b7f9-4165-9db1-af1b16e67194-kube-api-access-6xxqf\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.810167 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.810136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-oauth-serving-cert\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.810241 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.810207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b7629f-b7f9-4165-9db1-af1b16e67194-console-oauth-config\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.810275 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.810266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-console-config\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.818655 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.818634 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6775f5b-xrtmh"] Jun 15 03:25:49.823323 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.823301 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:49.885168 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.885126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:49.911567 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b7629f-b7f9-4165-9db1-af1b16e67194-console-oauth-config\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.911635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-console-config\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.911776 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911760 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-trusted-ca-bundle\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.911852 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-service-ca\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.911906 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b7629f-b7f9-4165-9db1-af1b16e67194-console-serving-cert\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.911906 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xxqf\" (UniqueName: \"kubernetes.io/projected/85b7629f-b7f9-4165-9db1-af1b16e67194-kube-api-access-6xxqf\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.912008 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.911928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-oauth-serving-cert\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.912489 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.912467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-console-config\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.912595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.912558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-trusted-ca-bundle\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.912595 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.912566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-service-ca\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.912702 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.912641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b7629f-b7f9-4165-9db1-af1b16e67194-oauth-serving-cert\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.913928 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.913908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b7629f-b7f9-4165-9db1-af1b16e67194-console-oauth-config\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.914113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.914096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b7629f-b7f9-4165-9db1-af1b16e67194-console-serving-cert\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:49.922416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:49.922391 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xxqf\" (UniqueName: \"kubernetes.io/projected/85b7629f-b7f9-4165-9db1-af1b16e67194-kube-api-access-6xxqf\") pod \"console-5c6775f5b-xrtmh\" (UID: \"85b7629f-b7f9-4165-9db1-af1b16e67194\") " pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:50.110350 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:50.110284 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:25:50.244476 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:50.244443 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6775f5b-xrtmh"] Jun 15 03:25:50.246682 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:25:50.246610 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b7629f_b7f9_4165_9db1_af1b16e67194.slice/crio-9d6e0cdf1fa53754aedf29effbda85f940af20620e86c1ec9bd0e997550dd791 WatchSource:0}: Error finding container 9d6e0cdf1fa53754aedf29effbda85f940af20620e86c1ec9bd0e997550dd791: Status 404 returned error can't find the container with id 9d6e0cdf1fa53754aedf29effbda85f940af20620e86c1ec9bd0e997550dd791 Jun 15 03:25:51.148911 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:51.148879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6775f5b-xrtmh" event={"ID":"85b7629f-b7f9-4165-9db1-af1b16e67194","Type":"ContainerStarted","Data":"a1e7d3a3d1628d61807deb76a96370aa9e70056af8b425fa51cab9c49144a182"} Jun 15 03:25:51.149350 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:51.148930 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6775f5b-xrtmh" event={"ID":"85b7629f-b7f9-4165-9db1-af1b16e67194","Type":"ContainerStarted","Data":"9d6e0cdf1fa53754aedf29effbda85f940af20620e86c1ec9bd0e997550dd791"} Jun 15 03:25:51.168125 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:51.168081 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6775f5b-xrtmh" podStartSLOduration=2.168068456 podStartE2EDuration="2.168068456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:25:51.166515016 +0000 UTC m=+470.610709722" watchObservedRunningTime="2026-06-15 03:25:51.168068456 +0000 UTC m=+470.612263163" Jun 15 03:25:55.119820 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:55.119791 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bwwpd" Jun 15 03:25:55.867488 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:55.867458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:55.952752 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:55.952722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:25:58.135281 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:58.135254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t8wj6" Jun 15 03:25:59.199243 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.199211 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9"] Jun 15 03:25:59.199655 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.199458 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" containerName="manager" containerID="cri-o://e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c" gracePeriod=2 Jun 15 03:25:59.215929 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.215907 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9"] Jun 15 03:25:59.219215 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:25:59.219140 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"99344b7c-8a86-43cf-addd-463bfd0a6bfb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8jqs9\": pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:59.230222 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.230195 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj"] Jun 15 03:25:59.230749 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.230732 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" containerName="manager" Jun 15 03:25:59.230795 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.230752 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" containerName="manager" Jun 15 03:25:59.230843 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.230832 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" containerName="manager" Jun 15 03:25:59.234116 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.234099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:25:59.236858 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:25:59.236832 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:59.245009 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.244985 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj"] Jun 15 03:25:59.285424 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.285402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhpq7\" (UniqueName: \"kubernetes.io/projected/d757d35d-181c-434d-9e17-cbae82c7e95c-kube-api-access-xhpq7\") pod \"limitador-operator-controller-manager-859d7b78bd-92fmj\" (UID: \"d757d35d-181c-434d-9e17-cbae82c7e95c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:25:59.386704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.386675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhpq7\" (UniqueName: \"kubernetes.io/projected/d757d35d-181c-434d-9e17-cbae82c7e95c-kube-api-access-xhpq7\") pod \"limitador-operator-controller-manager-859d7b78bd-92fmj\" (UID: \"d757d35d-181c-434d-9e17-cbae82c7e95c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:25:59.399351 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.399320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhpq7\" (UniqueName: \"kubernetes.io/projected/d757d35d-181c-434d-9e17-cbae82c7e95c-kube-api-access-xhpq7\") pod \"limitador-operator-controller-manager-859d7b78bd-92fmj\" (UID: \"d757d35d-181c-434d-9e17-cbae82c7e95c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:25:59.440106 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.440084 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:59.442561 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:25:59.442537 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:25:59.487744 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.487694 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2669k\" (UniqueName: \"kubernetes.io/projected/99344b7c-8a86-43cf-addd-463bfd0a6bfb-kube-api-access-2669k\") pod \"99344b7c-8a86-43cf-addd-463bfd0a6bfb\" (UID: \"99344b7c-8a86-43cf-addd-463bfd0a6bfb\") " Jun 15 03:25:59.489557 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.489535 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99344b7c-8a86-43cf-addd-463bfd0a6bfb-kube-api-access-2669k" (OuterVolumeSpecName: "kube-api-access-2669k") pod "99344b7c-8a86-43cf-addd-463bfd0a6bfb" (UID: "99344b7c-8a86-43cf-addd-463bfd0a6bfb"). InnerVolumeSpecName "kube-api-access-2669k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:25:59.586883 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.586857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:25:59.588181 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.588142 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2669k\" (UniqueName: \"kubernetes.io/projected/99344b7c-8a86-43cf-addd-463bfd0a6bfb-kube-api-access-2669k\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:25:59.724198 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:25:59.724173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj"] Jun 15 03:25:59.726671 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:25:59.726643 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd757d35d_181c_434d_9e17_cbae82c7e95c.slice/crio-b797f2eba17f15e7f9f951f1d0cc5a89e064cfd3b19a8c52c9dcbb555bb3a620 WatchSource:0}: Error finding container b797f2eba17f15e7f9f951f1d0cc5a89e064cfd3b19a8c52c9dcbb555bb3a620: Status 404 returned error can't find the container with id b797f2eba17f15e7f9f951f1d0cc5a89e064cfd3b19a8c52c9dcbb555bb3a620 Jun 15 03:26:00.111165 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.111042 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:26:00.111165 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.111102 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:26:00.115840 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.115814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:26:00.138890 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:26:00.138860 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:26:00.190389 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.190359 2559 generic.go:356] "Generic (PLEG): container finished" podID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" containerID="e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c" exitCode=0 Jun 15 03:26:00.190517 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.190403 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:26:00.190517 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.190454 2559 scope.go:117] "RemoveContainer" containerID="e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c" Jun 15 03:26:00.192214 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.192186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" event={"ID":"d757d35d-181c-434d-9e17-cbae82c7e95c","Type":"ContainerStarted","Data":"0117e8c297989c7e57eacd74e4e66b92ffbb9e8c7773e9d8e0581b4a7bab9ad7"} Jun 15 03:26:00.192342 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.192240 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" event={"ID":"d757d35d-181c-434d-9e17-cbae82c7e95c","Type":"ContainerStarted","Data":"b797f2eba17f15e7f9f951f1d0cc5a89e064cfd3b19a8c52c9dcbb555bb3a620"} Jun 15 03:26:00.192936 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:26:00.192813 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:26:00.194786 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:26:00.194761 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:26:00.196838 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.196819 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6775f5b-xrtmh" Jun 15 03:26:00.200239 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.200052 2559 scope.go:117] "RemoveContainer" containerID="e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c" Jun 15 03:26:00.200473 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:26:00.200328 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c\": container with ID starting with e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c not found: ID does not exist" containerID="e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c" Jun 15 03:26:00.200473 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.200351 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c"} err="failed to get container status \"e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c\": rpc error: code = NotFound desc = could not find container \"e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c\": container with ID starting with e9edc312d96647041cfaa4bc1ab996a2be3ae66f02b06ba91283c34f9c75eb0c not found: ID does not exist" Jun 15 03:26:00.211035 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.210999 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" podStartSLOduration=1.210983698 podStartE2EDuration="1.210983698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:26:00.209812662 +0000 UTC m=+479.654007369" watchObservedRunningTime="2026-06-15 03:26:00.210983698 +0000 UTC m=+479.655178404" Jun 15 03:26:00.211929 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:26:00.211902 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:26:00.452526 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.452491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:00.562929 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.562900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:00.664032 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:00.664009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:01.045832 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:26:01.045792 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8jqs9\" is forbidden: User \"system:node:ip-10-0-134-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-131.ec2.internal' and this object" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqs9" Jun 15 03:26:01.046770 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:01.046749 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99344b7c-8a86-43cf-addd-463bfd0a6bfb" path="/var/lib/kubelet/pods/99344b7c-8a86-43cf-addd-463bfd0a6bfb/volumes" Jun 15 03:26:01.196692 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:01.196668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:26:02.448990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:02.448946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:02.526667 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:02.526621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:02.626860 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:02.626832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:04.960899 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:04.960867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:05.056043 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:05.056007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:07.793306 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:07.793270 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:07.890328 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:07.890299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:12.203420 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:12.203394 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92fmj" Jun 15 03:26:14.738260 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:14.738224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:14.792822 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:14.792791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:21.143616 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:21.143588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:21.244408 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:21.244380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:21.345449 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:21.345420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:27.927326 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:27.927293 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph"] Jun 15 03:26:27.934710 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:27.934691 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:27.938317 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:27.938297 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-grtqr\"" Jun 15 03:26:27.950577 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:27.950554 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph"] Jun 15 03:26:27.974678 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:27.974655 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:28.019100 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019206 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019315 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019315 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019384 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xnth\" (UniqueName: \"kubernetes.io/projected/99ccbc66-3b46-4d55-842b-aaf0c603dc89-kube-api-access-4xnth\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019419 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.019468 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.019446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120042 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120193 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120193 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xnth\" (UniqueName: \"kubernetes.io/projected/99ccbc66-3b46-4d55-842b-aaf0c603dc89-kube-api-access-4xnth\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120193 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120193 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120614 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120839 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120929 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.120998 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.120951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.121047 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.121024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.122523 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.122505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.122658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.122639 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.128314 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.128293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xnth\" (UniqueName: \"kubernetes.io/projected/99ccbc66-3b46-4d55-842b-aaf0c603dc89-kube-api-access-4xnth\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.128503 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.128483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99ccbc66-3b46-4d55-842b-aaf0c603dc89-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-zd5ph\" (UID: \"99ccbc66-3b46-4d55-842b-aaf0c603dc89\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.227174 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.227081 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:28.245142 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.245116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:28.379660 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.379634 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph"] Jun 15 03:26:28.381986 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:26:28.381960 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ccbc66_3b46_4d55_842b_aaf0c603dc89.slice/crio-8c23989053ffd80457ca4219ac251e1f407d75226aeeca3416dac7d9e05c647e WatchSource:0}: Error finding container 8c23989053ffd80457ca4219ac251e1f407d75226aeeca3416dac7d9e05c647e: Status 404 returned error can't find the container with id 8c23989053ffd80457ca4219ac251e1f407d75226aeeca3416dac7d9e05c647e Jun 15 03:26:28.384525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.384493 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:26:28.384617 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.384560 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:26:28.384617 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:28.384586 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:26:29.322065 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:29.322030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" event={"ID":"99ccbc66-3b46-4d55-842b-aaf0c603dc89","Type":"ContainerStarted","Data":"abde16c92b73cb2997fe16a1c30e53ad62fb4d9c931b16994a9fc827f61fe62e"} Jun 15 03:26:29.322452 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:29.322079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" event={"ID":"99ccbc66-3b46-4d55-842b-aaf0c603dc89","Type":"ContainerStarted","Data":"8c23989053ffd80457ca4219ac251e1f407d75226aeeca3416dac7d9e05c647e"} Jun 15 03:26:29.342877 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:29.342836 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" podStartSLOduration=2.342821438 podStartE2EDuration="2.342821438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:26:29.342171944 +0000 UTC m=+508.786366671" watchObservedRunningTime="2026-06-15 03:26:29.342821438 +0000 UTC m=+508.787016144" Jun 15 03:26:30.245452 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.245415 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:30.250457 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.250433 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:30.310833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.310806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:30.326647 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.326611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:30.327715 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.327690 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:26:30.416218 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.416187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:30.516585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:30.516484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:31.137814 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:31.137777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:31.196001 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:31.195974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:26:51.919896 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:26:51.919814 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:02.213928 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:02.213898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:02.314928 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:02.314901 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:02.451063 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:02.451033 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:32.085185 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.085134 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:32.183962 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.183926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:32.478551 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.478522 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:27:32.481945 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.481926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:32.484844 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.484824 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 03:27:32.484961 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.484923 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 03:27:32.485953 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.485936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lvdqv\"" Jun 15 03:27:32.486082 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.485958 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 03:27:32.490604 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.490581 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:27:32.654044 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.654008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlcss\" (UniqueName: \"kubernetes.io/projected/a81b5ba9-2caf-445a-b724-c3d1cad83121-kube-api-access-rlcss\") pod \"maas-keycloak-0\" (UID: \"a81b5ba9-2caf-445a-b724-c3d1cad83121\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:32.754881 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.754811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlcss\" (UniqueName: \"kubernetes.io/projected/a81b5ba9-2caf-445a-b724-c3d1cad83121-kube-api-access-rlcss\") pod \"maas-keycloak-0\" (UID: \"a81b5ba9-2caf-445a-b724-c3d1cad83121\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:32.763801 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.763780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlcss\" (UniqueName: \"kubernetes.io/projected/a81b5ba9-2caf-445a-b724-c3d1cad83121-kube-api-access-rlcss\") pod \"maas-keycloak-0\" (UID: \"a81b5ba9-2caf-445a-b724-c3d1cad83121\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:32.791645 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.791619 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:32.924802 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:32.924777 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:27:32.926417 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:27:32.926384 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81b5ba9_2caf_445a_b724_c3d1cad83121.slice/crio-fe3f1b60e1cced0af6397cd627181dafcccf79804fc28f6cbf59d55d733680bc WatchSource:0}: Error finding container fe3f1b60e1cced0af6397cd627181dafcccf79804fc28f6cbf59d55d733680bc: Status 404 returned error can't find the container with id fe3f1b60e1cced0af6397cd627181dafcccf79804fc28f6cbf59d55d733680bc Jun 15 03:27:33.614903 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:33.614862 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a81b5ba9-2caf-445a-b724-c3d1cad83121","Type":"ContainerStarted","Data":"fe3f1b60e1cced0af6397cd627181dafcccf79804fc28f6cbf59d55d733680bc"} Jun 15 03:27:37.551830 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:37.551794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:37.602504 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:37.602403 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:27:37.640740 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:37.640706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a81b5ba9-2caf-445a-b724-c3d1cad83121","Type":"ContainerStarted","Data":"4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e"} Jun 15 03:27:37.660282 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:37.660233 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.264599077 podStartE2EDuration="5.660218825s" totalImagesPullingTime="4.395619748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:27:37.65783264 +0000 UTC m=+577.102027344" watchObservedRunningTime="2026-06-15 03:27:37.660218825 +0000 UTC m=+577.104413579" Jun 15 03:27:37.792614 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:37.792578 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:37.794643 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:37.794598 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:38.792661 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:38.792611 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:39.792868 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:39.792819 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:40.792251 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:40.792203 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:41.792461 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:41.792403 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:42.792475 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:42.792421 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:42.792969 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:42.792870 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:43.792719 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:43.792654 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:44.792779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:44.792730 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:45.792881 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:45.792836 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:46.792125 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:46.792072 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:47.792129 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:47.792074 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:48.792194 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:48.792131 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:49.792556 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:49.792509 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 03:27:50.879793 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:50.879742 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 03:27:50.894369 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:27:50.894315 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 03:28:00.886455 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:00.886415 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:01.027501 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:01.027469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:28:01.031192 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:01.031168 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:28:01.525947 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:01.525908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:01.857282 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:01.857207 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:07.345118 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.345083 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-hpjhf"] Jun 15 03:28:07.348448 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.348428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:07.349283 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.349252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:07.351368 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.351334 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 03:28:07.351529 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.351375 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wxwkq\"" Jun 15 03:28:07.351529 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.351436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 03:28:07.359104 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.359080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-hpjhf"] Jun 15 03:28:07.503320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.503288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:07.503516 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.503381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9w7\" (UniqueName: \"kubernetes.io/projected/02ecc73c-fc96-4af5-b74c-cb702876e89d-kube-api-access-pr9w7\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:07.604272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.604193 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:07.604272 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.604241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9w7\" (UniqueName: \"kubernetes.io/projected/02ecc73c-fc96-4af5-b74c-cb702876e89d-kube-api-access-pr9w7\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:07.604476 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:28:07.604338 2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 15 03:28:07.604476 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:28:07.604400 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert podName:02ecc73c-fc96-4af5-b74c-cb702876e89d nodeName:}" failed. No retries permitted until 2026-06-15 03:28:08.104381001 +0000 UTC m=+607.548575702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert") pod "maas-controller-6bc9b988dc-hpjhf" (UID: "02ecc73c-fc96-4af5-b74c-cb702876e89d") : secret "maas-controller-webhook-cert" not found Jun 15 03:28:07.612618 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:07.612597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9w7\" (UniqueName: \"kubernetes.io/projected/02ecc73c-fc96-4af5-b74c-cb702876e89d-kube-api-access-pr9w7\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:08.108841 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:08.108812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:08.111114 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:08.111097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert\") pod \"maas-controller-6bc9b988dc-hpjhf\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:08.259624 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:08.259593 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:08.388943 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:08.388918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-hpjhf"] Jun 15 03:28:08.391064 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:28:08.391039 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ecc73c_fc96_4af5_b74c_cb702876e89d.slice/crio-64ea5bd8e32bb4c99d6565eee095c8c6a389f93579af1287e27587389aa08054 WatchSource:0}: Error finding container 64ea5bd8e32bb4c99d6565eee095c8c6a389f93579af1287e27587389aa08054: Status 404 returned error can't find the container with id 64ea5bd8e32bb4c99d6565eee095c8c6a389f93579af1287e27587389aa08054 Jun 15 03:28:08.528543 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:08.528515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:08.819448 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:08.819370 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" event={"ID":"02ecc73c-fc96-4af5-b74c-cb702876e89d","Type":"ContainerStarted","Data":"64ea5bd8e32bb4c99d6565eee095c8c6a389f93579af1287e27587389aa08054"} Jun 15 03:28:10.634529 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:10.634497 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:10.730616 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:10.730528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:10.831132 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:10.831096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" event={"ID":"02ecc73c-fc96-4af5-b74c-cb702876e89d","Type":"ContainerStarted","Data":"e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674"} Jun 15 03:28:10.831373 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:10.831190 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:10.851531 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:10.851489 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" podStartSLOduration=1.829114636 podStartE2EDuration="3.851475009s" totalImagesPullingTime="2.022360373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:28:10.849605922 +0000 UTC m=+610.293800653" watchObservedRunningTime="2026-06-15 03:28:10.851475009 +0000 UTC m=+610.295669715" Jun 15 03:28:21.841787 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:21.841705 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:22.383673 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.383634 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-hpjhf"] Jun 15 03:28:22.383906 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.383875 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" podUID="02ecc73c-fc96-4af5-b74c-cb702876e89d" containerName="manager" containerID="cri-o://e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674" gracePeriod=30 Jun 15 03:28:22.624674 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.624654 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:22.629225 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.629208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert\") pod \"02ecc73c-fc96-4af5-b74c-cb702876e89d\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " Jun 15 03:28:22.629284 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.629257 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr9w7\" (UniqueName: \"kubernetes.io/projected/02ecc73c-fc96-4af5-b74c-cb702876e89d-kube-api-access-pr9w7\") pod \"02ecc73c-fc96-4af5-b74c-cb702876e89d\" (UID: \"02ecc73c-fc96-4af5-b74c-cb702876e89d\") " Jun 15 03:28:22.631335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.631309 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "02ecc73c-fc96-4af5-b74c-cb702876e89d" (UID: "02ecc73c-fc96-4af5-b74c-cb702876e89d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:28:22.631419 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.631376 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ecc73c-fc96-4af5-b74c-cb702876e89d-kube-api-access-pr9w7" (OuterVolumeSpecName: "kube-api-access-pr9w7") pod "02ecc73c-fc96-4af5-b74c-cb702876e89d" (UID: "02ecc73c-fc96-4af5-b74c-cb702876e89d"). InnerVolumeSpecName "kube-api-access-pr9w7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:28:22.729797 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.729767 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02ecc73c-fc96-4af5-b74c-cb702876e89d-webhook-cert\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:28:22.729797 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.729790 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr9w7\" (UniqueName: \"kubernetes.io/projected/02ecc73c-fc96-4af5-b74c-cb702876e89d-kube-api-access-pr9w7\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:28:22.889559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.889467 2559 generic.go:356] "Generic (PLEG): container finished" podID="02ecc73c-fc96-4af5-b74c-cb702876e89d" containerID="e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674" exitCode=0 Jun 15 03:28:22.889559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.889513 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" Jun 15 03:28:22.890026 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.889568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" event={"ID":"02ecc73c-fc96-4af5-b74c-cb702876e89d","Type":"ContainerDied","Data":"e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674"} Jun 15 03:28:22.890026 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.889615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-hpjhf" event={"ID":"02ecc73c-fc96-4af5-b74c-cb702876e89d","Type":"ContainerDied","Data":"64ea5bd8e32bb4c99d6565eee095c8c6a389f93579af1287e27587389aa08054"} Jun 15 03:28:22.890026 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.889639 2559 scope.go:117] "RemoveContainer" containerID="e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674" Jun 15 03:28:22.898918 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.898904 2559 scope.go:117] "RemoveContainer" containerID="e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674" Jun 15 03:28:22.899180 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:28:22.899143 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674\": container with ID starting with e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674 not found: ID does not exist" containerID="e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674" Jun 15 03:28:22.899226 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.899188 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674"} err="failed to get container status \"e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674\": rpc error: code = NotFound desc = could not find container \"e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674\": container with ID starting with e5ecc5fa6824e6de08d58a3aef912833ab590d101f8c5649bb7aeceab696e674 not found: ID does not exist" Jun 15 03:28:22.911489 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.911468 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-hpjhf"] Jun 15 03:28:22.915317 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:22.915294 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-hpjhf"] Jun 15 03:28:23.047537 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:23.047510 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ecc73c-fc96-4af5-b74c-cb702876e89d" path="/var/lib/kubelet/pods/02ecc73c-fc96-4af5-b74c-cb702876e89d/volumes" Jun 15 03:28:30.673949 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:30.673913 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:30.723068 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:30.723035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:41.545835 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:41.545793 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:41.602163 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:41.602118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:42.308028 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.307979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:42.368679 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.368648 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-79d5d876dc-6nnmc"] Jun 15 03:28:42.369012 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.368999 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ecc73c-fc96-4af5-b74c-cb702876e89d" containerName="manager" Jun 15 03:28:42.369075 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.369013 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ecc73c-fc96-4af5-b74c-cb702876e89d" containerName="manager" Jun 15 03:28:42.369075 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.369068 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ecc73c-fc96-4af5-b74c-cb702876e89d" containerName="manager" Jun 15 03:28:42.373268 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.373252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.376922 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.376899 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7nftz\"" Jun 15 03:28:42.376922 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.376915 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 03:28:42.382931 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.382908 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-79d5d876dc-6nnmc"] Jun 15 03:28:42.490208 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.490178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4c38a4-f901-4173-bae0-a5306e96a1bb-maas-api-tls\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.490373 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.490250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q75f2\" (UniqueName: \"kubernetes.io/projected/be4c38a4-f901-4173-bae0-a5306e96a1bb-kube-api-access-q75f2\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.490373 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.490274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4c38a4-f901-4173-bae0-a5306e96a1bb-openshift-service-ca\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.554757 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.554726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:42.591335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.591266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q75f2\" (UniqueName: \"kubernetes.io/projected/be4c38a4-f901-4173-bae0-a5306e96a1bb-kube-api-access-q75f2\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.591335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.591304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4c38a4-f901-4173-bae0-a5306e96a1bb-openshift-service-ca\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.591499 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.591356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4c38a4-f901-4173-bae0-a5306e96a1bb-maas-api-tls\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.592001 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.591981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4c38a4-f901-4173-bae0-a5306e96a1bb-openshift-service-ca\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.593702 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.593685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4c38a4-f901-4173-bae0-a5306e96a1bb-maas-api-tls\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.599035 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.599015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q75f2\" (UniqueName: \"kubernetes.io/projected/be4c38a4-f901-4173-bae0-a5306e96a1bb-kube-api-access-q75f2\") pod \"maas-api-79d5d876dc-6nnmc\" (UID: \"be4c38a4-f901-4173-bae0-a5306e96a1bb\") " pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.684240 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.684215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:42.744683 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.744651 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:42.829275 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.829247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-79d5d876dc-6nnmc"] Jun 15 03:28:42.831906 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.831875 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:28:42.832340 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:28:42.832305 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4c38a4_f901_4173_bae0_a5306e96a1bb.slice/crio-d4d0e3af55a57f4289b0caaea8b284ebff4750257c68df35eca488f06d0364b9 WatchSource:0}: Error finding container d4d0e3af55a57f4289b0caaea8b284ebff4750257c68df35eca488f06d0364b9: Status 404 returned error can't find the container with id d4d0e3af55a57f4289b0caaea8b284ebff4750257c68df35eca488f06d0364b9 Jun 15 03:28:42.833627 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.833611 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:28:42.854310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.854255 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-948vb"] Jun 15 03:28:42.858630 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.858614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:42.861078 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.861060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bnbdb\"" Jun 15 03:28:42.861200 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.861100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 03:28:42.869391 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.869370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-948vb"] Jun 15 03:28:42.885761 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.885741 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-9n7st"] Jun 15 03:28:42.888958 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.888942 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:42.893771 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.893752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vz74\" (UniqueName: \"kubernetes.io/projected/d0f2af20-3979-4d88-be51-226d85b7502c-kube-api-access-9vz74\") pod \"payload-pre-processing-579785bc64-948vb\" (UID: \"d0f2af20-3979-4d88-be51-226d85b7502c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:42.900615 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.900592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-9n7st"] Jun 15 03:28:42.984669 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.984644 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-79d5d876dc-6nnmc" event={"ID":"be4c38a4-f901-4173-bae0-a5306e96a1bb","Type":"ContainerStarted","Data":"d4d0e3af55a57f4289b0caaea8b284ebff4750257c68df35eca488f06d0364b9"} Jun 15 03:28:42.995176 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.995125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vz74\" (UniqueName: \"kubernetes.io/projected/d0f2af20-3979-4d88-be51-226d85b7502c-kube-api-access-9vz74\") pod \"payload-pre-processing-579785bc64-948vb\" (UID: \"d0f2af20-3979-4d88-be51-226d85b7502c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:42.995286 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:42.995213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvmmf\" (UniqueName: \"kubernetes.io/projected/bf84d3e9-8bac-49d2-92d2-add40d1519c9-kube-api-access-kvmmf\") pod \"payload-processing-699b6cd6c-9n7st\" (UID: \"bf84d3e9-8bac-49d2-92d2-add40d1519c9\") " pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:43.002990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.002973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vz74\" (UniqueName: \"kubernetes.io/projected/d0f2af20-3979-4d88-be51-226d85b7502c-kube-api-access-9vz74\") pod \"payload-pre-processing-579785bc64-948vb\" (UID: \"d0f2af20-3979-4d88-be51-226d85b7502c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:43.095751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.095718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvmmf\" (UniqueName: \"kubernetes.io/projected/bf84d3e9-8bac-49d2-92d2-add40d1519c9-kube-api-access-kvmmf\") pod \"payload-processing-699b6cd6c-9n7st\" (UID: \"bf84d3e9-8bac-49d2-92d2-add40d1519c9\") " pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:43.103597 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.103575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvmmf\" (UniqueName: \"kubernetes.io/projected/bf84d3e9-8bac-49d2-92d2-add40d1519c9-kube-api-access-kvmmf\") pod \"payload-processing-699b6cd6c-9n7st\" (UID: \"bf84d3e9-8bac-49d2-92d2-add40d1519c9\") " pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:43.170541 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.170516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:43.198602 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.198579 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:43.317768 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.317704 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-948vb"] Jun 15 03:28:43.320328 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:28:43.320302 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f2af20_3979_4d88_be51_226d85b7502c.slice/crio-d0bd496edf04e754feed71be84268b9eff29c5c864c2e734d3fa5d55849691df WatchSource:0}: Error finding container d0bd496edf04e754feed71be84268b9eff29c5c864c2e734d3fa5d55849691df: Status 404 returned error can't find the container with id d0bd496edf04e754feed71be84268b9eff29c5c864c2e734d3fa5d55849691df Jun 15 03:28:43.342319 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.339586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-9n7st"] Jun 15 03:28:43.995187 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.995078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" event={"ID":"bf84d3e9-8bac-49d2-92d2-add40d1519c9","Type":"ContainerStarted","Data":"1b65a03852f075a26e67f6c56ea4b21daf6a3162d22f907be6fd8e0697bf1d84"} Jun 15 03:28:43.997716 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:43.997679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" event={"ID":"d0f2af20-3979-4d88-be51-226d85b7502c","Type":"ContainerStarted","Data":"d0bd496edf04e754feed71be84268b9eff29c5c864c2e734d3fa5d55849691df"} Jun 15 03:28:47.015818 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.015782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" event={"ID":"d0f2af20-3979-4d88-be51-226d85b7502c","Type":"ContainerStarted","Data":"8595da4c9a454df1a45cdef2d8f4e1c548a1e074eef8ce4d89be7a1fa27647b9"} Jun 15 03:28:47.016311 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.015871 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:47.017353 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.017330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-79d5d876dc-6nnmc" event={"ID":"be4c38a4-f901-4173-bae0-a5306e96a1bb","Type":"ContainerStarted","Data":"eb4ab04c41e9436d6c6be070198e30d5ad8759bd0ee20da4075dbe6cf6cf1ead"} Jun 15 03:28:47.017478 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.017385 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:47.018656 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.018629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" event={"ID":"bf84d3e9-8bac-49d2-92d2-add40d1519c9","Type":"ContainerStarted","Data":"5fdd23b05a2b7ba9f4e47a67bf6d95705e04c7ab0772df90b96d868a7b6030bc"} Jun 15 03:28:47.018738 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.018695 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:47.033721 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.033678 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" podStartSLOduration=1.778812557 podStartE2EDuration="5.033660332s" totalImagesPullingTime="3.254847775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:28:47.032567395 +0000 UTC m=+646.476762122" watchObservedRunningTime="2026-06-15 03:28:47.033660332 +0000 UTC m=+646.477855040" Jun 15 03:28:47.076004 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.075942 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-79d5d876dc-6nnmc" podStartSLOduration=2.740075935 podStartE2EDuration="5.075920233s" totalImagesPullingTime="2.335844298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:28:47.055676065 +0000 UTC m=+646.499870773" watchObservedRunningTime="2026-06-15 03:28:47.075920233 +0000 UTC m=+646.520114941" Jun 15 03:28:47.077746 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:47.077706 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" podStartSLOduration=1.8524182219999998 podStartE2EDuration="5.077693376s" totalImagesPullingTime="3.225275154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:28:47.075545616 +0000 UTC m=+646.519740323" watchObservedRunningTime="2026-06-15 03:28:47.077693376 +0000 UTC m=+646.521888081" Jun 15 03:28:51.039416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:51.039381 2559 generic.go:356] "Generic (PLEG): container finished" podID="99ccbc66-3b46-4d55-842b-aaf0c603dc89" containerID="abde16c92b73cb2997fe16a1c30e53ad62fb4d9c931b16994a9fc827f61fe62e" exitCode=0 Jun 15 03:28:51.040085 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:51.039452 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" event={"ID":"99ccbc66-3b46-4d55-842b-aaf0c603dc89","Type":"ContainerDied","Data":"abde16c92b73cb2997fe16a1c30e53ad62fb4d9c931b16994a9fc827f61fe62e"} Jun 15 03:28:51.040085 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:51.039842 2559 scope.go:117] "RemoveContainer" containerID="abde16c92b73cb2997fe16a1c30e53ad62fb4d9c931b16994a9fc827f61fe62e" Jun 15 03:28:51.040800 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:51.040770 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:28:51.040894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:51.040843 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:28:51.040894 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:51.040878 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 03:28:52.049751 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:52.049715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" event={"ID":"99ccbc66-3b46-4d55-842b-aaf0c603dc89","Type":"ContainerStarted","Data":"0bd05b226288c3fdd4128057e60991f3294bec6ae89905e56aec9907c4bd19d5"} Jun 15 03:28:52.245991 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:52.245948 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:28:52.246328 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:52.246302 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zd5ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 03:28:52.246502 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:52.246476 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" podUID="99ccbc66-3b46-4d55-842b-aaf0c603dc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 03:28:53.028837 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:53.028810 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-79d5d876dc-6nnmc" Jun 15 03:28:53.245763 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:53.245725 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zd5ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 03:28:53.246659 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:53.246344 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" podUID="99ccbc66-3b46-4d55-842b-aaf0c603dc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 03:28:54.246296 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:54.246257 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zd5ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 03:28:54.246913 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:54.246876 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" podUID="99ccbc66-3b46-4d55-842b-aaf0c603dc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 03:28:54.267963 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:54.267937 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:28:54.268123 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:54.268104 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" containerID="cri-o://4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e" gracePeriod=30 Jun 15 03:28:55.246449 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:55.246402 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zd5ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 03:28:55.246958 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:55.246470 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" podUID="99ccbc66-3b46-4d55-842b-aaf0c603dc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 03:28:55.917687 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:55.917655 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.030952 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.030862 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlcss\" (UniqueName: \"kubernetes.io/projected/a81b5ba9-2caf-445a-b724-c3d1cad83121-kube-api-access-rlcss\") pod \"a81b5ba9-2caf-445a-b724-c3d1cad83121\" (UID: \"a81b5ba9-2caf-445a-b724-c3d1cad83121\") " Jun 15 03:28:56.033075 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.033050 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81b5ba9-2caf-445a-b724-c3d1cad83121-kube-api-access-rlcss" (OuterVolumeSpecName: "kube-api-access-rlcss") pod "a81b5ba9-2caf-445a-b724-c3d1cad83121" (UID: "a81b5ba9-2caf-445a-b724-c3d1cad83121"). InnerVolumeSpecName "kube-api-access-rlcss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:28:56.081562 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.081534 2559 generic.go:356] "Generic (PLEG): container finished" podID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerID="4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e" exitCode=143 Jun 15 03:28:56.081668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.081576 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.081668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.081590 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a81b5ba9-2caf-445a-b724-c3d1cad83121","Type":"ContainerDied","Data":"4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e"} Jun 15 03:28:56.081668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.081640 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a81b5ba9-2caf-445a-b724-c3d1cad83121","Type":"ContainerDied","Data":"fe3f1b60e1cced0af6397cd627181dafcccf79804fc28f6cbf59d55d733680bc"} Jun 15 03:28:56.081668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.081667 2559 scope.go:117] "RemoveContainer" containerID="4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e" Jun 15 03:28:56.090693 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.090663 2559 scope.go:117] "RemoveContainer" containerID="4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e" Jun 15 03:28:56.090941 ip-10-0-134-131 kubenswrapper[2559]: E0615 03:28:56.090924 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e\": container with ID starting with 4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e not found: ID does not exist" containerID="4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e" Jun 15 03:28:56.090996 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.090950 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e"} err="failed to get container status \"4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e\": rpc error: code = NotFound desc = could not find container \"4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e\": container with ID starting with 4fd85c8066e9e37767b6dc91485bbac0c21455042807a5c2f205870f9ea2319e not found: ID does not exist" Jun 15 03:28:56.108553 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.108530 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:28:56.113665 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.113646 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:28:56.132398 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.132373 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlcss\" (UniqueName: \"kubernetes.io/projected/a81b5ba9-2caf-445a-b724-c3d1cad83121-kube-api-access-rlcss\") on node \"ip-10-0-134-131.ec2.internal\" DevicePath \"\"" Jun 15 03:28:56.141077 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.141056 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:28:56.141483 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.141469 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" Jun 15 03:28:56.141535 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.141485 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" Jun 15 03:28:56.141585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.141558 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" containerName="keycloak" Jun 15 03:28:56.146511 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.146495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.152833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.152804 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 03:28:56.152933 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.152895 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lvdqv\"" Jun 15 03:28:56.152933 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.152907 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 03:28:56.153086 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.153054 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 03:28:56.153133 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.153120 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 03:28:56.158942 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.158922 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:28:56.233584 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.233556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8ba23763-9223-454e-8a8f-04222fd0145e-test-realms\") pod \"maas-keycloak-0\" (UID: \"8ba23763-9223-454e-8a8f-04222fd0145e\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.233713 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.233663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqxs5\" (UniqueName: \"kubernetes.io/projected/8ba23763-9223-454e-8a8f-04222fd0145e-kube-api-access-qqxs5\") pod \"maas-keycloak-0\" (UID: \"8ba23763-9223-454e-8a8f-04222fd0145e\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.249161 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.249134 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:28:56.249460 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.249397 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:28:56.250124 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.250107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zd5ph" Jun 15 03:28:56.334513 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.334441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqxs5\" (UniqueName: \"kubernetes.io/projected/8ba23763-9223-454e-8a8f-04222fd0145e-kube-api-access-qqxs5\") pod \"maas-keycloak-0\" (UID: \"8ba23763-9223-454e-8a8f-04222fd0145e\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.334668 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.334517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8ba23763-9223-454e-8a8f-04222fd0145e-test-realms\") pod \"maas-keycloak-0\" (UID: \"8ba23763-9223-454e-8a8f-04222fd0145e\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.335240 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.335216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8ba23763-9223-454e-8a8f-04222fd0145e-test-realms\") pod \"maas-keycloak-0\" (UID: \"8ba23763-9223-454e-8a8f-04222fd0145e\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.344069 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.344047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqxs5\" (UniqueName: \"kubernetes.io/projected/8ba23763-9223-454e-8a8f-04222fd0145e-kube-api-access-qqxs5\") pod \"maas-keycloak-0\" (UID: \"8ba23763-9223-454e-8a8f-04222fd0145e\") " pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.456143 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.456117 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:56.589079 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:56.589005 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 03:28:56.592024 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:28:56.591998 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba23763_9223_454e_8a8f_04222fd0145e.slice/crio-edf991ff41906391cddc54b7a253c88662910f663933dcc2798cc0085075a09b WatchSource:0}: Error finding container edf991ff41906391cddc54b7a253c88662910f663933dcc2798cc0085075a09b: Status 404 returned error can't find the container with id edf991ff41906391cddc54b7a253c88662910f663933dcc2798cc0085075a09b Jun 15 03:28:57.048860 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:57.048838 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a81b5ba9-2caf-445a-b724-c3d1cad83121" path="/var/lib/kubelet/pods/a81b5ba9-2caf-445a-b724-c3d1cad83121/volumes" Jun 15 03:28:57.089176 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:57.089135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ba23763-9223-454e-8a8f-04222fd0145e","Type":"ContainerStarted","Data":"b2cd5560c911192d988b6b3e2be550835437032c7e9e41ba754abcaa312fe7ed"} Jun 15 03:28:57.089274 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:57.089196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ba23763-9223-454e-8a8f-04222fd0145e","Type":"ContainerStarted","Data":"edf991ff41906391cddc54b7a253c88662910f663933dcc2798cc0085075a09b"} Jun 15 03:28:57.110281 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:57.110240 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.713147589 podStartE2EDuration="1.110226663s" totalImagesPullingTime="397.079074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:28:57.10791102 +0000 UTC m=+656.552105738" watchObservedRunningTime="2026-06-15 03:28:57.110226663 +0000 UTC m=+656.554421369" Jun 15 03:28:57.456320 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:57.456281 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 03:28:57.458071 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:57.458037 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:28:58.025567 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:58.025530 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-948vb" Jun 15 03:28:58.025757 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:58.025718 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-9n7st" Jun 15 03:28:58.456631 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:58.456580 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:28:59.457026 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:28:59.456972 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:00.456640 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:00.456586 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:01.456800 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:01.456749 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:02.456686 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:02.456636 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:03.457450 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:03.457405 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:04.456981 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:04.456924 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:05.456612 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:05.456572 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:06.457573 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:06.456877 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 03:29:06.457573 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:06.457177 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:07.457571 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:07.457526 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:08.457136 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:08.457082 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:09.457458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:09.457412 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 03:29:10.575500 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:10.575464 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 03:29:10.595135 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:10.595083 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8ba23763-9223-454e-8a8f-04222fd0145e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 03:29:20.581806 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:20.581771 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 03:29:32.821862 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:32.821818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:29:32.920168 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:32.920113 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:29:57.391704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.391624 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz"] Jun 15 03:29:57.395647 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.395626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.399467 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.399440 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 03:29:57.399573 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.399452 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sx5dg\"" Jun 15 03:29:57.399635 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.399526 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 03:29:57.399779 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.399757 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 03:29:57.406097 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.406075 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz"] Jun 15 03:29:57.427990 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.427960 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:29:57.580389 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.580363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.580553 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.580421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.580553 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.580470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.580553 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.580490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84b7796b-3bb7-4974-85f2-6c1b3df70ada-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.580553 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.580527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pxvl\" (UniqueName: \"kubernetes.io/projected/84b7796b-3bb7-4974-85f2-6c1b3df70ada-kube-api-access-2pxvl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.580700 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.580585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.681833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.681764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.681833 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.681810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.681980 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.681857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84b7796b-3bb7-4974-85f2-6c1b3df70ada-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.681980 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.681894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pxvl\" (UniqueName: \"kubernetes.io/projected/84b7796b-3bb7-4974-85f2-6c1b3df70ada-kube-api-access-2pxvl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.682096 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.682079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.682144 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.682105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.682225 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.682188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.682342 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.682312 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.682449 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.682435 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.684223 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.684204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84b7796b-3bb7-4974-85f2-6c1b3df70ada-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.684399 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.684385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84b7796b-3bb7-4974-85f2-6c1b3df70ada-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.689325 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.689300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pxvl\" (UniqueName: \"kubernetes.io/projected/84b7796b-3bb7-4974-85f2-6c1b3df70ada-kube-api-access-2pxvl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz\" (UID: \"84b7796b-3bb7-4974-85f2-6c1b3df70ada\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.707189 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.707169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:29:57.842376 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:57.842349 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz"] Jun 15 03:29:57.844250 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:29:57.844218 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b7796b_3bb7_4974_85f2_6c1b3df70ada.slice/crio-44bcd9b0fb798bb1f9de991c8da29ada8331ec4b5ef77fe8885c5529d6a5bcf1 WatchSource:0}: Error finding container 44bcd9b0fb798bb1f9de991c8da29ada8331ec4b5ef77fe8885c5529d6a5bcf1: Status 404 returned error can't find the container with id 44bcd9b0fb798bb1f9de991c8da29ada8331ec4b5ef77fe8885c5529d6a5bcf1 Jun 15 03:29:58.450527 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:29:58.450496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" event={"ID":"84b7796b-3bb7-4974-85f2-6c1b3df70ada","Type":"ContainerStarted","Data":"44bcd9b0fb798bb1f9de991c8da29ada8331ec4b5ef77fe8885c5529d6a5bcf1"} Jun 15 03:30:02.476760 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:02.476721 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" event={"ID":"84b7796b-3bb7-4974-85f2-6c1b3df70ada","Type":"ContainerStarted","Data":"2153f713ef4b63be82d7e7819701322c2ce7d8428210a221d1111e1cccde0579"} Jun 15 03:30:04.921886 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:04.921853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:30:22.101585 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.101546 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq"] Jun 15 03:30:22.105354 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.105336 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.109440 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.109422 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 15 03:30:22.116129 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.116104 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq"] Jun 15 03:30:22.131649 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.131624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:30:22.183672 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.183647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.183780 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.183675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h857\" (UniqueName: \"kubernetes.io/projected/2bdf894e-1237-47eb-b559-626dd589e7ab-kube-api-access-6h857\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.183780 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.183721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.183877 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.183814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.183877 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.183840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.183877 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.183874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bdf894e-1237-47eb-b559-626dd589e7ab-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284435 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284435 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h857\" (UniqueName: \"kubernetes.io/projected/2bdf894e-1237-47eb-b559-626dd589e7ab-kube-api-access-6h857\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284662 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284834 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284834 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284955 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284882 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.284955 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.284899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bdf894e-1237-47eb-b559-626dd589e7ab-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.285117 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.285100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.286826 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.286802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bdf894e-1237-47eb-b559-626dd589e7ab-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.287226 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.287206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bdf894e-1237-47eb-b559-626dd589e7ab-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.293024 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.293000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h857\" (UniqueName: \"kubernetes.io/projected/2bdf894e-1237-47eb-b559-626dd589e7ab-kube-api-access-6h857\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq\" (UID: \"2bdf894e-1237-47eb-b559-626dd589e7ab\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.416576 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.416538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:22.551958 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.551934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq"] Jun 15 03:30:22.553951 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:30:22.553927 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdf894e_1237_47eb_b559_626dd589e7ab.slice/crio-e0fe607dcf412c9a9e96d0a696f04bf23436b462653f4fba3574b82e1e9347d4 WatchSource:0}: Error finding container e0fe607dcf412c9a9e96d0a696f04bf23436b462653f4fba3574b82e1e9347d4: Status 404 returned error can't find the container with id e0fe607dcf412c9a9e96d0a696f04bf23436b462653f4fba3574b82e1e9347d4 Jun 15 03:30:22.577443 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:22.577419 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" event={"ID":"2bdf894e-1237-47eb-b559-626dd589e7ab","Type":"ContainerStarted","Data":"e0fe607dcf412c9a9e96d0a696f04bf23436b462653f4fba3574b82e1e9347d4"} Jun 15 03:30:23.583703 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:23.583665 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" event={"ID":"2bdf894e-1237-47eb-b559-626dd589e7ab","Type":"ContainerStarted","Data":"ee21a6ea3cc5e31eda985341d0f4b018c1b9ddab8b5aa9a3fc8e48cc13bd95d2"} Jun 15 03:30:27.605642 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:27.605604 2559 generic.go:356] "Generic (PLEG): container finished" podID="2bdf894e-1237-47eb-b559-626dd589e7ab" containerID="ee21a6ea3cc5e31eda985341d0f4b018c1b9ddab8b5aa9a3fc8e48cc13bd95d2" exitCode=0 Jun 15 03:30:27.606131 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:27.605680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" event={"ID":"2bdf894e-1237-47eb-b559-626dd589e7ab","Type":"ContainerDied","Data":"ee21a6ea3cc5e31eda985341d0f4b018c1b9ddab8b5aa9a3fc8e48cc13bd95d2"} Jun 15 03:30:28.713490 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:28.713449 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:30:29.617533 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:29.617502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" event={"ID":"2bdf894e-1237-47eb-b559-626dd589e7ab","Type":"ContainerStarted","Data":"6ba1dc7091ccbdf09ba2dfea782285a36ba44bf4f0fc60a5da3c69a485ce69c1"} Jun 15 03:30:29.640299 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:29.640250 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" podStartSLOduration=2.480578181 podStartE2EDuration="7.640232123s" totalImagesPullingTime="1.110841157s" totalInitContainerRuntime="4.048812785s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:30:29.638137674 +0000 UTC m=+749.082332399" watchObservedRunningTime="2026-06-15 03:30:29.640232123 +0000 UTC m=+749.084426829" Jun 15 03:30:32.416992 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:32.416962 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:32.417416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:32.417039 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:32.429261 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:32.429236 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:32.645918 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:32.645894 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq" Jun 15 03:30:34.165923 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.165874 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f"] Jun 15 03:30:34.170054 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.170036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.172633 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.172612 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 15 03:30:34.181638 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.181614 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f"] Jun 15 03:30:34.192918 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.192884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:30:34.301221 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.301193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.301338 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.301228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rphl\" (UniqueName: \"kubernetes.io/projected/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-kube-api-access-5rphl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.301338 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.301258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.301338 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.301324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.301447 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.301359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.301447 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.301380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.401926 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.401895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402054 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.401935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402054 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.401972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402054 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.402015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402054 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.402036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rphl\" (UniqueName: \"kubernetes.io/projected/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-kube-api-access-5rphl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.402065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402395 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.402371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402454 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.402421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.402499 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.402456 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.404329 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.404307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.404517 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.404502 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.411259 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.411235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rphl\" (UniqueName: \"kubernetes.io/projected/fe3d4210-df87-4cd5-9f0b-e6bfe6784845-kube-api-access-5rphl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f\" (UID: \"fe3d4210-df87-4cd5-9f0b-e6bfe6784845\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.482111 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.482056 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:34.618415 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.618387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f"] Jun 15 03:30:34.620202 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:30:34.620171 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3d4210_df87_4cd5_9f0b_e6bfe6784845.slice/crio-8e1294a2216e35a0699fd533f32f62fbc4ded1eac13fa0a38d0aa054a9cae3ac WatchSource:0}: Error finding container 8e1294a2216e35a0699fd533f32f62fbc4ded1eac13fa0a38d0aa054a9cae3ac: Status 404 returned error can't find the container with id 8e1294a2216e35a0699fd533f32f62fbc4ded1eac13fa0a38d0aa054a9cae3ac Jun 15 03:30:34.645260 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:34.645236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" event={"ID":"fe3d4210-df87-4cd5-9f0b-e6bfe6784845","Type":"ContainerStarted","Data":"8e1294a2216e35a0699fd533f32f62fbc4ded1eac13fa0a38d0aa054a9cae3ac"} Jun 15 03:30:35.653077 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:35.653036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" event={"ID":"fe3d4210-df87-4cd5-9f0b-e6bfe6784845","Type":"ContainerStarted","Data":"a045fb1a31f43182d81aa6ea258a6b94a9cecd8cc6bde45d49b36fea1055dd09"} Jun 15 03:30:36.664806 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:36.664763 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe3d4210-df87-4cd5-9f0b-e6bfe6784845" containerID="a045fb1a31f43182d81aa6ea258a6b94a9cecd8cc6bde45d49b36fea1055dd09" exitCode=0 Jun 15 03:30:36.665200 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:36.664852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" event={"ID":"fe3d4210-df87-4cd5-9f0b-e6bfe6784845","Type":"ContainerDied","Data":"a045fb1a31f43182d81aa6ea258a6b94a9cecd8cc6bde45d49b36fea1055dd09"} Jun 15 03:30:37.671893 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:37.671860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" event={"ID":"fe3d4210-df87-4cd5-9f0b-e6bfe6784845","Type":"ContainerStarted","Data":"ccc8bd58567beb444afa640989a0613fd07a2e3c65829e9205ccdacc7815ec26"} Jun 15 03:30:37.690951 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:37.690905 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" podStartSLOduration=2.271601143 podStartE2EDuration="3.690892051s" totalImagesPullingTime="167.00381ms" totalInitContainerRuntime="1.252287098s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:30:37.688893781 +0000 UTC m=+757.133088477" watchObservedRunningTime="2026-06-15 03:30:37.690892051 +0000 UTC m=+757.135086754" Jun 15 03:30:42.005968 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:42.005938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:30:44.482850 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:44.482817 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:44.483245 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:44.482881 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:44.495127 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:44.495107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:44.717620 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:44.717586 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f" Jun 15 03:30:54.475607 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:54.475572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:30:56.772842 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:56.772806 2559 generic.go:356] "Generic (PLEG): container finished" podID="84b7796b-3bb7-4974-85f2-6c1b3df70ada" containerID="2153f713ef4b63be82d7e7819701322c2ce7d8428210a221d1111e1cccde0579" exitCode=0 Jun 15 03:30:56.773306 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:56.772880 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" event={"ID":"84b7796b-3bb7-4974-85f2-6c1b3df70ada","Type":"ContainerDied","Data":"2153f713ef4b63be82d7e7819701322c2ce7d8428210a221d1111e1cccde0579"} Jun 15 03:30:57.780561 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:57.780524 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" event={"ID":"84b7796b-3bb7-4974-85f2-6c1b3df70ada","Type":"ContainerStarted","Data":"62e05407cb2e9d63a92ff36ce074febbc977c7d5fd5f49047fcc476c026d6a2c"} Jun 15 03:30:57.803365 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:30:57.803294 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" podStartSLOduration=2.7398622870000002 podStartE2EDuration="1m0.803278435s" totalImagesPullingTime="4.015871357s" totalInitContainerRuntime="54.047544791s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:29:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:30:57.801425829 +0000 UTC m=+777.245620535" watchObservedRunningTime="2026-06-15 03:30:57.803278435 +0000 UTC m=+777.247473141" Jun 15 03:31:07.707288 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:07.707252 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:31:07.707756 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:07.707317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:31:07.719762 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:07.719741 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:31:07.840234 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:07.840207 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz" Jun 15 03:31:38.394327 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:38.394230 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:31:38.493162 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:38.493125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:31:39.471974 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:39.471937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:31:39.575950 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:31:39.575911 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:32:48.682565 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:32:48.682523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:32:51.720474 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:32:51.720440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:00.068673 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:00.068635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:00.170113 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:00.170076 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:01.071664 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:01.071631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:33:01.072072 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:01.071734 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:33:08.151747 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:08.151712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:09.749327 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.749294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:09.872507 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.872426 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c47fc7664-fcgwh"] Jun 15 03:33:09.876232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.876212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:09.879772 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.879749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wxwkq\"" Jun 15 03:33:09.879772 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.879764 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 03:33:09.879961 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.879777 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 03:33:09.885186 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.885143 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c47fc7664-fcgwh"] Jun 15 03:33:09.944592 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.944557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5b4224f-63b5-43c2-93e9-32097458d248-webhook-cert\") pod \"maas-controller-7c47fc7664-fcgwh\" (UID: \"c5b4224f-63b5-43c2-93e9-32097458d248\") " pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:09.944745 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:09.944669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vdfz\" (UniqueName: \"kubernetes.io/projected/c5b4224f-63b5-43c2-93e9-32097458d248-kube-api-access-7vdfz\") pod \"maas-controller-7c47fc7664-fcgwh\" (UID: \"c5b4224f-63b5-43c2-93e9-32097458d248\") " pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:10.045941 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.045857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdfz\" (UniqueName: \"kubernetes.io/projected/c5b4224f-63b5-43c2-93e9-32097458d248-kube-api-access-7vdfz\") pod \"maas-controller-7c47fc7664-fcgwh\" (UID: \"c5b4224f-63b5-43c2-93e9-32097458d248\") " pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:10.045941 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.045913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5b4224f-63b5-43c2-93e9-32097458d248-webhook-cert\") pod \"maas-controller-7c47fc7664-fcgwh\" (UID: \"c5b4224f-63b5-43c2-93e9-32097458d248\") " pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:10.048324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.048299 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5b4224f-63b5-43c2-93e9-32097458d248-webhook-cert\") pod \"maas-controller-7c47fc7664-fcgwh\" (UID: \"c5b4224f-63b5-43c2-93e9-32097458d248\") " pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:10.053684 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.053661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vdfz\" (UniqueName: \"kubernetes.io/projected/c5b4224f-63b5-43c2-93e9-32097458d248-kube-api-access-7vdfz\") pod \"maas-controller-7c47fc7664-fcgwh\" (UID: \"c5b4224f-63b5-43c2-93e9-32097458d248\") " pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:10.187581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.187551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:10.323310 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.323223 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c47fc7664-fcgwh"] Jun 15 03:33:10.325516 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:33:10.325488 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b4224f_63b5_43c2_93e9_32097458d248.slice/crio-4647509be122145194fa3b91ea6c54249984b562b8a05b1ac2bd139653ad2f1b WatchSource:0}: Error finding container 4647509be122145194fa3b91ea6c54249984b562b8a05b1ac2bd139653ad2f1b: Status 404 returned error can't find the container with id 4647509be122145194fa3b91ea6c54249984b562b8a05b1ac2bd139653ad2f1b Jun 15 03:33:10.443078 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:10.443041 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" event={"ID":"c5b4224f-63b5-43c2-93e9-32097458d248","Type":"ContainerStarted","Data":"4647509be122145194fa3b91ea6c54249984b562b8a05b1ac2bd139653ad2f1b"} Jun 15 03:33:11.448940 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:11.448898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" event={"ID":"c5b4224f-63b5-43c2-93e9-32097458d248","Type":"ContainerStarted","Data":"5fd121771e90b1a8aff73fce6778298d39c8ea007f3156798340c71497fabe53"} Jun 15 03:33:11.449381 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:11.448965 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:11.466336 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:11.466287 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" podStartSLOduration=2.063835115 podStartE2EDuration="2.466272352s" totalImagesPullingTime="402.437237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:33:11.464697502 +0000 UTC m=+910.908892210" watchObservedRunningTime="2026-06-15 03:33:11.466272352 +0000 UTC m=+910.910467057" Jun 15 03:33:22.459772 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:22.459736 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c47fc7664-fcgwh" Jun 15 03:33:50.002940 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:50.002897 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:50.100541 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:50.100508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:33:58.519443 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:33:58.519407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:34:04.348799 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:34:04.348761 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:34:04.412268 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:34:04.412236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:34:36.552581 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:34:36.552489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:34:36.644311 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:34:36.644283 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:00.502538 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:00.502504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:06.440522 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:06.440487 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:06.544682 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:06.544651 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:06.642262 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:06.642233 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:06.797741 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:06.797601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:06.891746 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:06.891712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:23.397271 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:23.397238 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:23.511458 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:23.511409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:23.613263 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:23.613227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:27.136534 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:27.136499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:27.188950 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:27.188923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:29.281394 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:29.281358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:29.379358 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:29.379308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:37.423525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:37.423470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:37.519306 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:37.519273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:37.619341 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:37.619308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:37.735432 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:37.735360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:54.146376 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:54.146300 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:54.256781 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:54.256748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:35:54.362760 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:35:54.362724 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:00.051007 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:00.050972 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:00.151252 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:00.151221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:16.297884 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:16.297854 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:16.393295 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:16.393265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:16.498552 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:16.498517 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:22.289821 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:22.289791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:22.348232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:22.348202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:22.424872 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:22.424804 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:22.524106 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:22.524079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:22.625037 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:22.624929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:28.413777 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:28.413736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:28.515283 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:28.515254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:36:37.648570 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:36:37.648528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:38:01.102453 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:38:01.102427 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:38:01.104927 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:38:01.104907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:38:32.135804 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:38:32.135761 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:38:33.085959 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:38:33.085916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:43:01.141078 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:43:01.141050 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:43:01.146344 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:43:01.146323 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:44:09.305213 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:44:09.305177 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:45:55.013654 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:45:55.013622 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:48:01.176938 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:48:01.176909 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:48:01.185056 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:48:01.185037 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:51:43.063376 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:51:43.063347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:51:44.055944 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:51:44.055901 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:52:44.188318 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:52:44.188276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:52:49.600101 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:52:49.600067 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:01.209841 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:01.209817 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:53:01.219003 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:01.218980 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lnxn5_ce6a63ad-ee47-40fc-80ee-afc141091523/ovn-acl-logging/0.log" Jun 15 03:53:13.850696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:13.850661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:26.904339 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:26.904304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:28.536493 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:28.536465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:28.634407 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:28.634374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:28.734525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:28.734491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:28.838733 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:28.838642 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:32.054473 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:32.054443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:34.741007 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:34.740969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:34.937648 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:34.937599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:35.037788 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:35.037710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:36.234828 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:36.234784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:40.694728 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:40.694684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:40.750658 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:40.750632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:40.901246 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:40.901211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:41.001338 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:41.001256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:41.104203 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:41.104174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:41.202111 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:41.202085 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:44.023854 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:44.023807 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:47.157782 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:47.157733 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:48.302650 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:48.302621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:48.402734 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:48.402697 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:49.939274 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:49.939233 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:54.010716 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:54.010674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:54.110033 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:54.110001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:57.489731 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:57.489690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:53:57.539784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:53:57.539746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:54:05.048394 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:05.048358 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7dfff65d9-9ttgk_ca47a677-e807-4b60-8088-b554ceaff616/nginx/0.log" Jun 15 03:54:05.392194 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:05.392131 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-79d5d876dc-6nnmc_be4c38a4-f901-4173-bae0-a5306e96a1bb/maas-api/0.log" Jun 15 03:54:05.729106 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:05.729032 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c47fc7664-fcgwh_c5b4224f-63b5-43c2-93e9-32097458d248/manager/0.log" Jun 15 03:54:06.303332 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:06.303300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-lr2bd_414c4dc1-abf5-495d-90cd-6bbb6501501c/copy-manifests/0.log" Jun 15 03:54:06.314984 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:06.314961 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-lr2bd_414c4dc1-abf5-495d-90cd-6bbb6501501c/manager/0.log" Jun 15 03:54:07.810348 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:07.810320 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t8wj6_8531f966-9bc8-44df-8fbb-695cd5145058/manager/0.log" Jun 15 03:54:07.926222 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:07.926195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bwwpd_3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4/manager/0.log" Jun 15 03:54:08.505795 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:08.505761 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-92fmj_d757d35d-181c-434d-9e17-cbae82c7e95c/manager/0.log" Jun 15 03:54:08.847362 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:08.847266 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gd7zp_ab2985ac-6336-4619-9def-5a31551bb4ed/istio-proxy/0.log" Jun 15 03:54:09.305102 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:09.305066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/1.log" Jun 15 03:54:09.418301 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:09.418272 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-948vb_d0f2af20-3979-4d88-be51-226d85b7502c/payload-pre-processing/0.log" Jun 15 03:54:09.533603 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:09.533578 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9n7st_bf84d3e9-8bac-49d2-92d2-add40d1519c9/payload-processing/0.log" Jun 15 03:54:09.987319 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:09.987291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz_84b7796b-3bb7-4974-85f2-6c1b3df70ada/storage-initializer/0.log" Jun 15 03:54:09.994356 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:09.994340 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-bzsqz_84b7796b-3bb7-4974-85f2-6c1b3df70ada/main/0.log" Jun 15 03:54:10.221620 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:10.221592 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq_2bdf894e-1237-47eb-b559-626dd589e7ab/storage-initializer/0.log" Jun 15 03:54:10.227807 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:10.227790 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-47msq_2bdf894e-1237-47eb-b559-626dd589e7ab/main/0.log" Jun 15 03:54:10.455128 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:10.455103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f_fe3d4210-df87-4cd5-9f0b-e6bfe6784845/storage-initializer/0.log" Jun 15 03:54:10.461569 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:10.461549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-k7v2f_fe3d4210-df87-4cd5-9f0b-e6bfe6784845/main/0.log" Jun 15 03:54:14.429324 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:14.429284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:54:14.530489 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:14.530459 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" limit=1024 Jun 15 03:54:17.419014 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:17.418978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xfmcz_12877bea-aec9-4962-b0ea-53657adcb9e1/global-pull-secret-syncer/0.log" Jun 15 03:54:17.464540 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:17.464518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-75qhw_f43cde1a-9c08-4a6a-9492-ecc277ec8612/konnectivity-agent/0.log" Jun 15 03:54:17.563895 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:17.563867 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-131.ec2.internal_bbce36964cb706e702654efc4cca68d1/haproxy/0.log" Jun 15 03:54:22.798756 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:22.798732 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t8wj6_8531f966-9bc8-44df-8fbb-695cd5145058/manager/0.log" Jun 15 03:54:22.830957 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:22.830936 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bwwpd_3796fc2f-4a09-4a8a-b1e3-aee6301eaeb4/manager/0.log" Jun 15 03:54:23.052140 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:23.052064 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-92fmj_d757d35d-181c-434d-9e17-cbae82c7e95c/manager/0.log" Jun 15 03:54:24.757891 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.757858 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-jrzxg_c11a57d1-f57f-434d-91e5-45854465be37/kube-state-metrics/0.log" Jun 15 03:54:24.783077 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.783050 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-jrzxg_c11a57d1-f57f-434d-91e5-45854465be37/kube-rbac-proxy-main/0.log" Jun 15 03:54:24.805918 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.805861 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-jrzxg_c11a57d1-f57f-434d-91e5-45854465be37/kube-rbac-proxy-self/0.log" Jun 15 03:54:24.866236 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.866215 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-6s97w_869a521a-fb7f-415f-9685-d14d86b5967e/monitoring-plugin/0.log" Jun 15 03:54:24.899556 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.899538 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89rzh_e4b988a1-3763-4da1-8819-044c925d9b51/node-exporter/0.log" Jun 15 03:54:24.919777 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.919754 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89rzh_e4b988a1-3763-4da1-8819-044c925d9b51/kube-rbac-proxy/0.log" Jun 15 03:54:24.941648 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:24.941627 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89rzh_e4b988a1-3763-4da1-8819-044c925d9b51/init-textfile/0.log" Jun 15 03:54:25.119536 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.119469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-tdmf9_8df3111b-f879-4a06-bf86-70bc22ef645e/kube-rbac-proxy-main/0.log" Jun 15 03:54:25.140599 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.140579 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-tdmf9_8df3111b-f879-4a06-bf86-70bc22ef645e/kube-rbac-proxy-self/0.log" Jun 15 03:54:25.161933 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.161914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-tdmf9_8df3111b-f879-4a06-bf86-70bc22ef645e/openshift-state-metrics/0.log" Jun 15 03:54:25.208559 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.208542 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/prometheus/0.log" Jun 15 03:54:25.236886 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.236869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/config-reloader/0.log" Jun 15 03:54:25.261122 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.261099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/thanos-sidecar/0.log" Jun 15 03:54:25.287080 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.287062 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/kube-rbac-proxy-web/0.log" Jun 15 03:54:25.309066 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.309052 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/kube-rbac-proxy/0.log" Jun 15 03:54:25.331425 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.331402 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/kube-rbac-proxy-thanos/0.log" Jun 15 03:54:25.351819 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.351805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51810a20-6027-40a1-be99-fca68667f710/init-config-reloader/0.log" Jun 15 03:54:25.394829 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.394810 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-h6gpf_24180e8d-2092-420e-907d-fc47b8b3a1ab/prometheus-operator/0.log" Jun 15 03:54:25.409472 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.409457 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-h6gpf_24180e8d-2092-420e-907d-fc47b8b3a1ab/kube-rbac-proxy/0.log" Jun 15 03:54:25.435029 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:25.435007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-t8c47_08ad4733-423b-4477-bfca-3adc77de85c6/prometheus-operator-admission-webhook/0.log" Jun 15 03:54:28.308700 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:28.308667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c6775f5b-xrtmh_85b7629f-b7f9-4165-9db1-af1b16e67194/console/0.log" Jun 15 03:54:28.346704 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:28.346675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-7dm2x_de7f22e9-5d98-41d7-97ec-3285990ea747/download-server/0.log" Jun 15 03:54:29.211262 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.211234 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594"] Jun 15 03:54:29.214890 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.214873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.217294 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.217275 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hnz2l\"/\"kube-root-ca.crt\"" Jun 15 03:54:29.218280 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.218260 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hnz2l\"/\"openshift-service-ca.crt\"" Jun 15 03:54:29.218383 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.218261 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hnz2l\"/\"default-dockercfg-prgpg\"" Jun 15 03:54:29.223838 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.223816 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594"] Jun 15 03:54:29.287643 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.287617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-proc\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.287759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.287669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-podres\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.287759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.287691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-lib-modules\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.287759 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.287726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72jq\" (UniqueName: \"kubernetes.io/projected/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-kube-api-access-m72jq\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.287874 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.287789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-sys\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.388574 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-podres\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.388574 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-lib-modules\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72jq\" (UniqueName: \"kubernetes.io/projected/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-kube-api-access-m72jq\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-sys\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-proc\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388698 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-podres\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-lib-modules\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388754 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-sys\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.389015 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.388758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-proc\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.397121 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.397095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72jq\" (UniqueName: \"kubernetes.io/projected/50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d-kube-api-access-m72jq\") pod \"perf-node-gather-daemonset-rj594\" (UID: \"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.526525 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.526459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.658632 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.658599 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594"] Jun 15 03:54:29.663539 ip-10-0-134-131 kubenswrapper[2559]: W0615 03:54:29.663507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod50cab93e_e3fc_4f49_b9ef_7b8b8ca4946d.slice/crio-400eca9389c03c880bcd2c3a4ebb2099594d48ab7a7e07f14631fad2a4a65338 WatchSource:0}: Error finding container 400eca9389c03c880bcd2c3a4ebb2099594d48ab7a7e07f14631fad2a4a65338: Status 404 returned error can't find the container with id 400eca9389c03c880bcd2c3a4ebb2099594d48ab7a7e07f14631fad2a4a65338 Jun 15 03:54:29.881141 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.881107 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" event={"ID":"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d","Type":"ContainerStarted","Data":"8d91dd1a8eb3a16aaec7ac3a8a890ab3f3dde5199f53a1d01eb59c90d42c475b"} Jun 15 03:54:29.881313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.881180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" event={"ID":"50cab93e-e3fc-4f49-b9ef-7b8b8ca4946d","Type":"ContainerStarted","Data":"400eca9389c03c880bcd2c3a4ebb2099594d48ab7a7e07f14631fad2a4a65338"} Jun 15 03:54:29.881313 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.881304 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:29.896572 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:29.896528 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" podStartSLOduration=0.896512191 podStartE2EDuration="896.512191ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:54:29.895096944 +0000 UTC m=+2189.339291651" watchObservedRunningTime="2026-06-15 03:54:29.896512191 +0000 UTC m=+2189.340706897" Jun 15 03:54:30.330317 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:30.330240 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gtks7_65f73157-5b8b-48c5-bbeb-2ac9302282eb/dns/0.log" Jun 15 03:54:30.349562 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:30.349536 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gtks7_65f73157-5b8b-48c5-bbeb-2ac9302282eb/kube-rbac-proxy/0.log" Jun 15 03:54:30.371915 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:30.371897 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-757bh_6afea764-6a01-4e6c-a431-4f39675daa82/dns-node-resolver/0.log" Jun 15 03:54:30.957767 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:30.957737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54f6896464-8pgmc_24b12bef-ddaf-4429-bb38-e1c1ddd3a008/registry/0.log" Jun 15 03:54:30.978398 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:30.978371 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-77tnc_6dbaa831-e640-4995-aa01-71d1286ee59f/node-ca/0.log" Jun 15 03:54:31.964314 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:31.964284 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gd7zp_ab2985ac-6336-4619-9def-5a31551bb4ed/istio-proxy/0.log" Jun 15 03:54:32.104651 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:32.104616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/0.log" Jun 15 03:54:32.134174 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:32.134129 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/1.log" Jun 15 03:54:32.166611 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:32.166590 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-948vb_d0f2af20-3979-4d88-be51-226d85b7502c/payload-pre-processing/0.log" Jun 15 03:54:32.224701 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:32.224638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9n7st_bf84d3e9-8bac-49d2-92d2-add40d1519c9/payload-processing/0.log" Jun 15 03:54:32.873597 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:32.873568 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bmdl_e4965bf9-d6c5-4ec1-92f8-24c6e537e2ea/serve-healthcheck-canary/0.log" Jun 15 03:54:33.511836 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:33.511802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pf8xd_02f43877-de12-40bb-b526-0bb2565a7943/kube-rbac-proxy/0.log" Jun 15 03:54:33.530939 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:33.530906 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pf8xd_02f43877-de12-40bb-b526-0bb2565a7943/exporter/0.log" Jun 15 03:54:33.550527 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:33.550498 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pf8xd_02f43877-de12-40bb-b526-0bb2565a7943/extractor/0.log" Jun 15 03:54:35.812335 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:35.812310 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7dfff65d9-9ttgk_ca47a677-e807-4b60-8088-b554ceaff616/nginx/0.log" Jun 15 03:54:35.899351 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:35.899317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rj594" Jun 15 03:54:35.946774 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:35.946746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-79d5d876dc-6nnmc_be4c38a4-f901-4173-bae0-a5306e96a1bb/maas-api/0.log" Jun 15 03:54:36.086899 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:36.086812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c47fc7664-fcgwh_c5b4224f-63b5-43c2-93e9-32097458d248/manager/0.log" Jun 15 03:54:36.340304 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:36.340234 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-lr2bd_414c4dc1-abf5-495d-90cd-6bbb6501501c/manager/0.log" Jun 15 03:54:36.356367 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:36.356345 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-lr2bd_414c4dc1-abf5-495d-90cd-6bbb6501501c/copy-manifests/0.log" Jun 15 03:54:37.976586 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:37.976545 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-94db46dd7-hqdwq_39e54551-f37c-46ec-969f-d2de3c80b258/manager/0.log" Jun 15 03:54:42.261110 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:42.261077 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gd7zp_ab2985ac-6336-4619-9def-5a31551bb4ed/istio-proxy/0.log" Jun 15 03:54:42.359929 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:42.359899 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/0.log" Jun 15 03:54:42.391164 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:42.391128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/1.log" Jun 15 03:54:42.408123 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:42.408105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-948vb_d0f2af20-3979-4d88-be51-226d85b7502c/payload-pre-processing/0.log" Jun 15 03:54:42.460912 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:42.460894 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9n7st_bf84d3e9-8bac-49d2-92d2-add40d1519c9/payload-processing/0.log" Jun 15 03:54:43.541648 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.541584 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gd7zp_ab2985ac-6336-4619-9def-5a31551bb4ed/istio-proxy/0.log" Jun 15 03:54:43.616889 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.616860 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-2pqdf_94f13a1a-3832-4b82-a8ce-57ce62fbbce1/migrator/0.log" Jun 15 03:54:43.636211 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.636185 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-2pqdf_94f13a1a-3832-4b82-a8ce-57ce62fbbce1/graceful-termination/0.log" Jun 15 03:54:43.640979 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.640952 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/0.log" Jun 15 03:54:43.676232 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.676206 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/1.log" Jun 15 03:54:43.695892 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.695874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-948vb_d0f2af20-3979-4d88-be51-226d85b7502c/payload-pre-processing/0.log" Jun 15 03:54:43.746696 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:43.746674 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9n7st_bf84d3e9-8bac-49d2-92d2-add40d1519c9/payload-processing/0.log" Jun 15 03:54:45.264021 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.263948 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/kube-multus-additional-cni-plugins/0.log" Jun 15 03:54:45.284567 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.284547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/egress-router-binary-copy/0.log" Jun 15 03:54:45.304784 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.304767 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/cni-plugins/0.log" Jun 15 03:54:45.324712 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.324695 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/bond-cni-plugin/0.log" Jun 15 03:54:45.344738 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.344714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/routeoverride-cni/0.log" Jun 15 03:54:45.366486 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.366466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/whereabouts-cni-bincopy/0.log" Jun 15 03:54:45.385416 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.385393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx2mb_d2bc74ab-7038-489a-b029-e35b3742632b/whereabouts-cni/0.log" Jun 15 03:54:45.390930 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.390900 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gd7zp_ab2985ac-6336-4619-9def-5a31551bb4ed/istio-proxy/0.log" Jun 15 03:54:45.484931 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.484912 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/0.log" Jun 15 03:54:45.513766 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.513746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zd5ph_99ccbc66-3b46-4d55-842b-aaf0c603dc89/istio-proxy/1.log" Jun 15 03:54:45.531511 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.531461 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-948vb_d0f2af20-3979-4d88-be51-226d85b7502c/payload-pre-processing/0.log" Jun 15 03:54:45.577117 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.577098 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9n7st_bf84d3e9-8bac-49d2-92d2-add40d1519c9/payload-processing/0.log" Jun 15 03:54:45.758567 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.758540 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sj4vt_79663e0e-89d9-4645-bb97-c0a037160592/kube-multus/0.log" Jun 15 03:54:45.891461 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.891442 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s79jd_bb40c396-e41d-4cf3-96a4-f8444b7ab6c2/network-metrics-daemon/0.log" Jun 15 03:54:45.911732 ip-10-0-134-131 kubenswrapper[2559]: I0615 03:54:45.911714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s79jd_bb40c396-e41d-4cf3-96a4-f8444b7ab6c2/kube-rbac-proxy/0.log"